00000001:02000400:2.0F:1787364959.764894:0:2964:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_hostid 00000001:02000400:1.0F:1787364979.663163:0:3187:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing load_modules_local 00000001:01000000:0.0F:1787364981.232828:0:3231:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm adler32 speed = 643 MB/s 00000001:01000000:2.0:1787364981.483457:0:3231:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32 speed = 591 MB/s 00000001:01000000:3.0F:1787364981.733316:0:3231:0:(lnet-crypto.c:359:cfs_crypto_performance_test()) Crypto hash algorithm crc32c speed = 3731 MB/s 00000020:02000000:2.0:1787364982.520449:0:3279:0:(class_obd.c:771:obdclass_init()) Lustre: Build Version: 2.17.57_46_g5381a3b 00000400:02000000:3.0:1787364983.524427:0:3294:0:(api-ni.c:2823:lnet_startup_lndni()) Added LNI 192.168.203.113@tcp [8/256/0/180] 00008000:02000000:2.0:1787364987.204928:0:3444:0:(echo_client.c:2574:obdecho_init()) Echo OBD driver; http://www.lustre.org/ 00000001:02000400:3.0:1787365035.634225:0:5244:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing load_modules_local 00000020:01000004:2.0:1787365047.537293:0:5814:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787365047.537301:0:5814:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:2.0:1787365047.537466:0:5814:0:(super25.c:131:lustre_fill_super()) VFS Op: sb 00000000c39929c5 00000080:02000400:2.0:1787365047.537481:0:5814:0:(super25.c:149:lustre_fill_super()) lustre-MDT0000: mounting server target with '-t lustre' deprecated, use '-t lustre_tgt' 00000020:01000004:2.0:1787365047.543724:0:5814:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200065, mountfl=0 00000020:01000004:2.0:1787365047.543743:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787365047.543829:0:5814:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (00000000b8de90fe) 00000020:00000080:2.0:1787365047.543859:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787365047.588099:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:3.0:1787365047.588801:0:5814:0:(scrub.c:230:scrub_file_store()) lustre-MDT0000: store scrub file: rc = 0 00100000:10000000:2.0:1787365047.613965:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787365047.614012:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787365047.614036:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787365047.614091:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787365047.614120:0:5814:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-MDT0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787365047.614943:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:2.0:1787365047.614953:0:5814:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787365047.614967:0:5814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x872d29295eb4695a 00000020:01000004:2.0:1787365047.614977:0:5814:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:2.0:1787365047.614983:0:5814:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:2.0:1787365047.614989:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c39929c5 from MGS 00000020:01000004:2.0:1787365047.614995:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:2.0:1787365047.615009:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGS (00000000e56c0321) 00000020:00000080:2.0:1787365047.615020:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:2.0:1787365047.615114:0:5814:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c39929c5 from MGS, refs=2 00080000:01000000:2.0:1787365047.615121:0:5814:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787365047.615126:0:5814:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x872d29295eb46968 00000100:00100000:2.0:1787365047.615237:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:2.0:1787365047.615462:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:2.0:1787365047.615476:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:0.0:1787365047.619412:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:0.0:1787365047.619433:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:0.0:1787365047.620415:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787365047.620756:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:0.0:1787365047.620763:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:0.0:1787365047.621871:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:0.0:1787365047.621884:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:0.0:1787365047.622418:0:5814:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:0.0:1787365047.622425:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:2.0:1787365047.623194:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365047.623199:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365047.623201:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365047.624168:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365047.624172:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365047.624174:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365047.624940:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:2.0:1787365047.626771:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:01000000:0.0:1787365047.874817:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip512 speed = 3083 MB/s 00000001:01000000:2.0:1787365048.125450:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10ip4K speed = 2295 MB/s 00000001:01000000:3.0:1787365048.376066:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc512 speed = 370 MB/s 00000001:01000000:1.0:1787365048.625906:0:5814:0:(integrity.c:236:obd_t10_performance_test()) MGS: T10 checksum algorithm t10crc4K speed = 743 MB/s 00080000:10000000:2.0:1787365048.655387:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00010000:00010000:2.0:1787365048.691158:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:3.0:1787365048.704145:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:3.0:1787365048.704168:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787365048.704172:0:5814:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:2.0:1787365048.708055:0:5825:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:3.0:1787365048.708187:0:5814:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:3.0:1787365048.708311:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000040:00080000:3.0:1787365048.708653:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787365048.708689:0:5814:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:0.0:1787365048.715669:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787365048.715909:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:0.0:1787365048.715917:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:0.0:1787365048.716301:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:0.0:1787365048.716308:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:0.0:1787365048.716431:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:0.0:1787365048.716437:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:1.0:1787365048.721270:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:1.0:1787365048.721301:0:5814:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.113@tcp' 00000020:01000004:1.0:1787365048.721303:0:5814:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:1.0:1787365048.721367:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.113@tcp (typ=mgc) 00000020:00000080:1.0:1787365048.721395:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.113@tcp (00000000c4b0d49b) 00000020:00000080:1.0:1787365048.721427:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:1.0:1787365048.721606:0:5814:0:(ldlm_lib.c:102:import_set_conn()) imp 000000006219248d@MGC192.168.203.113@tcp: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1787365048.721838:0:5814:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.113@tcp-0 is initialized 00000040:01000000:1.0:1787365048.721846:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 1 is initialized 00000100:00080000:2.0:1787365048.724445:0:5830:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:1.0:1787365048.729865:0:5832:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787365048.729931:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.113@tcp (uuid 65f8cd6c-cad4-438a-a88d-c44efaabba70) 00000020:00000080:1.0:1787365048.729962:0:5814:0:(genops.c:1385:class_connect()) connect: client 65f8cd6c-cad4-438a-a88d-c44efaabba70, cookie 0x872d29295eb46976 00000100:00080000:1.0:1787365048.729980:0:5814:0:(import.c:510:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787365048.729987:0:5814:0:(import.c:624:import_select_connection()) MGC192.168.203.113@tcp: import 000000006219248d using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1787365048.730073:0:5814:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000037230f08 x1874188024414336/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787365048.730100:0:5814:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import 65f8cd6c-cad4-438a-a88d-c44efaabba70->MGS 00000020:01000004:1.0:1787365048.730124:0:5814:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787365048.730131:0:5814:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787365048.730148:0:5814:0:(genops.c:413:class_newdev()) Allocate new device MDS (0000000094f49f15) 00000020:00000080:1.0:1787365048.730163:0:5814:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787365048.733481:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000037230f08 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:65f8cd6c-cad4-438a-a88d-c44efaabba70:3309:1874188024414336:0@lo:250: 00000100:00100000:0.0:1787365048.733808:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365048.733916:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024414336 00000100:00100000:0.0:1787365048.733927:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024414336 00000100:00100000:0.0:1787365048.733980:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787365048.733988:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a3fcc2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1874188024414336:12345-0@lo:250: 00010000:00080000:0.0:1787365048.734022:0:5827:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from 65f8cd6c-cad4-438a-a88d-c44efaabba70@0@lo t0 exp 0000000000000000 cur 165 last 0 00000020:00000080:0.0:1787365048.734057:0:5827:0:(genops.c:1385:class_connect()) connect: client 65f8cd6c-cad4-438a-a88d-c44efaabba70, cookie 0x872d29295eb46984 00000100:00080000:0.0:1787365048.734248:0:5827:0:(import.c:65:import_set_state_nolock()) 000000004427b1a7 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787365048.734308:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a3fcc2c0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+5:3309:x1874188024414336:12345-0@lo:250: Request processed in 319us (502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365048.734316:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787365048.734365:0:3309:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.113@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787365048.734376:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.113@tcp: connect to target with instance 0 00000100:00080000:0.0:1787365048.734394:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.113@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787365048.734399:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787365048.734403:0:3309:0:(import.c:65:import_set_state_nolock()) 000000006219248d MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787365048.734406:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787365048.734410:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787365048.734415:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000037230f08 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:65f8cd6c-cad4-438a-a88d-c44efaabba70:3309:1874188024414336:0@lo:250: 00000100:00100000:1.0:1787365048.759878:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787365048.760119:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787365048.760127:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:2.0:1787365048.763551:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:2.0:1787365048.763574:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787365048.764354:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787365048.764367:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:1.0:1787365048.765290:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787365048.765498:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:1.0:1787365048.765504:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787365048.769552:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787365048.769570:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:1.0:1787365048.826843:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787365048.827135:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:1.0:1787365048.827142:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:1.0:1787365048.829964:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:1.0:1787365048.829980:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:3.0:1787365048.830936:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787365048.831234:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787365048.831240:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:3.0:1787365048.831820:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787365048.831828:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:3.0:1787365048.832507:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787365048.832793:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787365048.832799:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:3.0:1787365048.833685:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787365048.833693:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:3.0:1787365048.834399:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787365048.834579:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:3.0:1787365048.834584:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:3.0:1787365048.835237:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:3.0:1787365048.835245:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:2.0:1787365048.866337:0:5814:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787365048.866804:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:2.0:1787365048.867039:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:2.0:1787365048.868179:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787365048.868187:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:1.0:1787365048.870509:0:5814:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:1.0:1787365048.870533:0:5814:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:1.0:1787365048.873829:0:5814:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:1.0:1787365048.873860:0:5814:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:1.0:1787365048.873867:0:5814:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:1.0:1787365048.874001:0:5814:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787365048.874038:0:5814:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20065 00000020:01000004:1.0:1787365048.874042:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787365048.874044:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787365048.874045:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787365048.874046:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787365048.874047:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787365048.874048:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787365048.874049:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787365048.874051:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787365048.874052:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787365048.874053:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787365048.874054:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787365048.874056:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787365048.874057:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020065 00000020:01000004:1.0:1787365048.874059:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787365048.874060:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787365048.874061:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787365048.874062:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787365048.874063:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787365048.874064:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787365048.874065:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787365048.874066:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787365048.874067:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787365048.874068:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787365048.874069:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787365048.874075:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787365048.874113:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787365048.874130:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7335282 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024414464:0@lo:253: 00000100:00100000:1.0:1787365048.874218:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365048.877597:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000008e492f5 going to sleep for 11 seconds 00000100:00100000:2.0:1787365048.877868:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024414464 00000100:00100000:2.0:1787365048.877877:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024414464 00000100:00100000:2.0:1787365048.878024:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787365048.878035:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000005ded541 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+5:5814:x1874188024414464:12345-0@lo:253: 20000000:01000000:2.0:1787365048.878093:0:5829:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:2.0:1787365048.878096:0:5829:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 10000000:01000000:2.0:1787365048.879290:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:3.0:1787365048.879345:0:5829:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 00000040:00080000:3.0:1787365048.880086:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787365048.881293:0:5850:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 64768 count 1 20000000:01000000:3.0:1787365048.882149:0:5829:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787365048.882155:0:5829:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-MDT0000, index=0 20000000:01000000:3.0:1787365048.882160:0:5829:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-MDT0000 to 0 20000000:01000000:3.0:1787365048.882163:0:5829:0:(mgs_llog.c:3612:mgs_write_log_mdt()) writing new mdt lustre-MDT0000 20000000:01000000:3.0:1787365048.882179:0:5829:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-MDT0000-mdtlov) log for lustre-MDT0000 00000040:00080000:3.0:1787365048.882398:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787365048.882940:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 20000000:01000000:3.0:1787365048.882956:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf001 lov lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:3.0:1787365048.883005:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 136 off8552 00000040:00080000:3.0:1787365048.883064:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 176 off8728 00000040:00080000:3.0:1787365048.883101:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8952 00000040:00080000:3.0:1787365048.883191:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9176 20000000:01000000:3.0:1787365048.883199:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf001 mdt lustre-MDT0000_UUID (null) (null) 00000040:00080000:3.0:1787365048.883244:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9296 20000000:01000000:3.0:1787365048.883252:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-MDT0000 lustre-MDT0000-mdtlov (null) (null) 00000040:00080000:3.0:1787365048.883283:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 112 off9408 20000000:01000000:3.0:1787365048.883290:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000 0xcf003 lustre-MDT0000_UUID 0 lustre-MDT0000-mdtlov f 00000040:00080000:3.0:1787365048.883314:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 160 off9568 00000040:00080000:3.0:1787365048.883357:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9792 00000040:00080000:3.0:1787365048.883384:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:01000000:3.0:1787365048.883388:0:5829:0:(mgs_llog.c:3172:mgs_write_log_lov()) Writing lov(lustre-clilov) log for lustre-client 00000040:00080000:3.0:1787365048.883398:0:5829:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787365048.883988:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 20000000:01000000:2.0:1787365048.884001:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf001 lov lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787365048.884038:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 120 off8536 00000040:00080000:2.0:1787365048.884069:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 168 off8704 00000040:00080000:2.0:1787365048.884129:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].4, 224 off8928 20000000:01000000:2.0:1787365048.884148:0:5829:0:(mgs_llog.c:3129:mgs_write_log_lmv()) Writing lmv(lustre-clilmv) log for lustre-client 00000040:00080000:2.0:1787365048.884217:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].5, 224 off9152 20000000:01000000:2.0:1787365048.884225:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf001 lmv lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787365048.884260:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].6, 120 off9272 00000040:00080000:2.0:1787365048.884289:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].7, 168 off9440 00000040:00080000:2.0:1787365048.884315:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].8, 224 off9664 20000000:01000000:2.0:1787365048.884325:0:5829:0:(mgs_llog.c:3094:mgs_write_log_mount_opt()) Writing mount options log for lustre-client 00000040:00080000:2.0:1787365048.884401:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].9, 224 off9888 20000000:01000000:2.0:1787365048.884539:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf007 lustre-client lustre-clilov lustre-clilmv (null) 00000040:00080000:2.0:1787365048.884574:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].10, 120 off10008 00000040:00080000:2.0:1787365048.884602:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].11, 224 off10232 00000040:00080000:2.0:1787365048.884857:0:5829:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 20000000:01000000:2.0:1787365048.884900:0:5829:0:(mgs_llog.c:3309:mgs_write_log_mdc_to_lmv()) adding mdc for lustre-MDT0000 to log lustre-client:lmv(lustre-clilmv) 20000000:01000000:2.0:1787365048.884907:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre-MDT0000/add mdc fl=4 00000040:00080000:0.0:1787365048.885284:0:5851:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 12 count 12 00000040:00080000:2.0:1787365048.885974:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].12, 224 off10456 20000000:01000000:2.0:1787365048.886000:0:5829:0:(mgs_llog.c:3355:mgs_write_log_mdc_to_lmv()) add nid 192.168.203.113@tcp for mdt 20000000:01000000:2.0:1787365048.886001:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:2.0:1787365048.886036:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].13, 88 off10544 20000000:01000000:2.0:1787365048.886044:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf001 mdc lustre-clilmv_UUID (null) (null) 00000040:00080000:2.0:1787365048.886074:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].14, 128 off10672 20000000:01000000:2.0:1787365048.886082:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdc 0xcf003 lustre-MDT0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:2.0:1787365048.886126:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].15, 144 off10816 20000000:01000000:2.0:1787365048.886136:0:5829:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilmv 0xcf014 lustre-MDT0000_UUID 0 1 lustre-MDT0000-mdc_UUID 00000040:00080000:2.0:1787365048.886166:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].16, 160 off10976 00000040:00080000:2.0:1787365048.886201:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].17, 224 off11200 20000000:01000000:2.0:1787365048.886263:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787365048.886267:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787365048.886270:0:5829:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787365048.886281:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787365048.886284:0:5829:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787365048.886312:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787365048.886323:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 00000040:00080000:2.0:1787365048.886998:0:5852:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 10 count 10 00000040:00080000:3.0:1787365048.887237:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 224 off10016 00000040:00080000:3.0:1787365048.887274:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 80 off10096 00000040:00080000:3.0:1787365048.887334:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10320 20000000:01000000:3.0:1787365048.887348:0:5829:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787365048.887350:0:5829:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 00000040:00080000:3.0:1787365048.887946:0:5853:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 18 count 18 00000040:00080000:2.0:1787365048.888155:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].18, 224 off11424 00000040:00080000:2.0:1787365048.888196:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].19, 80 off11504 00000040:00080000:2.0:1787365048.888244:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].20, 224 off11728 00000020:00000080:2.0:1787365048.888258:0:5829:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787365048.888261:0:5829:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 100 to 20 20000000:01000000:2.0:1787365048.888266:0:5829:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787365048.888268:0:5829:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity' 20000000:01000000:2.0:1787365048.888272:0:5829:0:(mgs_llog.c:5072:mgs_write_log_param()) mdt param identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity 20000000:01000000:2.0:1787365048.888278:0:5829:0:(mgs_llog.c:1379:mgs_modify_param()) modify lustre-MDT0000/lustre-MDT0000/mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity del=0 00000040:00080000:2.0:1787365048.888941:0:5854:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 13 count 13 20000000:02000000:3.0:1787365048.889047:0:5829:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre-MDT0000.mdt.identity_upcall=/home/green/git/lustre-release/lustre/utils/l_getidentity in log lustre-MDT0000 00000040:00080000:3.0:1787365048.907777:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 224 off10544 00000040:00080000:3.0:1787365048.907899:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 160 off10704 00000040:00080000:3.0:1787365048.907971:0:5829:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 224 off10928 10000000:01000000:3.0:1787365048.907996:0:5829:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787365048.908016:0:5829:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ae44888a/0x872d29295eb4698b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365048.908031:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ae44888a/0x872d29295eb4698b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365048.908052:0:5829:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ae44888a/0x872d29295eb4698b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365048.908058:0:5829:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ae44888a/0x872d29295eb4698b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365048.908064:0:5829:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ae44888a/0x872d29295eb4698b lrc: 3/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365048.908070:0:5829:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ae44888a/0x872d29295eb4698b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365048.908147:0:5829:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ae44888a already unused, calling callback (0000000055e1ebc8) 00010000:00010000:3.0:1787365048.908150:0:5829:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ae44888a/0x872d29295eb4698b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365048.908158:0:5829:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ae44888a/0x872d29295eb4698b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365048.908169:0:5829:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ae44888a/0x872d29295eb4698b lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365048.908177:0:5829:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ae44888a/0x872d29295eb4698b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365048.908183:0:5829:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ae44888a/0x872d29295eb4698b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:3.0:1787365048.908203:0:5829:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787365049.159487:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000005ded541 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+5:5814:x1874188024414464:12345-0@lo:253: Request processed in 281447us (285262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365049.159501:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787365049.159603:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7335282 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024414464:0@lo:253: 10000000:01000000:1.0:1787365049.159616:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787365049.159619:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787365049.159621:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787365049.159622:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787365049.159641:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-MDT0000_UUID 00000020:01000004:1.0:1787365049.159642:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787365049.159644:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787365049.159645:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787365049.159646:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787365049.159648:0:5814:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787365049.159649:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787365049.159651:0:5814:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787365049.159667:0:5814:0:(tgt_mount.c:101:server_register_mount()) register mount 00000000c39929c5 from lustre-MDT0000 10000000:01000000:1.0:1787365049.159689:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787365049.159691:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787365049.159695:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9f27872bb370 10000000:01000000:1.0:1787365049.159699:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787365049.159705:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f27872bb370 from 1 10000000:01000000:1.0:1787365049.159708:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787365049.159749:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000f2a5373f/0x872d29295eb46992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.159759:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000f2a5373f/0x872d29295eb46992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.159767:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000f2a5373f/0x872d29295eb46992 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365049.159796:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7335282 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024414592:0@lo:101: 00000100:00100000:1.0:1787365049.159826:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365049.159873:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000000b05ce2 going to sleep for 11 seconds 00000100:00100000:3.0:1787365049.159940:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024414592 00000100:00100000:3.0:1787365049.159946:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024414592 00000100:00100000:3.0:1787365049.160005:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787365049.160013:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ec069608 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+5:5814:x1874188024414592:12345-0@lo:101: 00010000:00010000:3.0:1787365049.160024:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365049.160034:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000ae44888a/0x872d29295eb46999 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46992 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365049.160052:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ae44888a/0x872d29295eb46999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46992 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365049.160061:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000ae44888a/0x872d29295eb46999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46992 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365049.160069:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000ae44888a, rc 0) 00000100:00100000:3.0:1787365049.160105:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ec069608 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+6:5814:x1874188024414592:12345-0@lo:101: Request processed in 94us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365049.160111:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787365049.162399:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7335282 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024414592:0@lo:101: 00010000:00010000:1.0:1787365049.162423:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000f2a5373f/0x872d29295eb46992 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46999 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.162434:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000f2a5373f/0x872d29295eb46992 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46999 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365049.162502:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7335282 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024414720:0@lo:501: 00000100:00100000:1.0:1787365049.162563:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365049.162604:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000000b05ce2 going to sleep for 11 seconds 00000100:00100000:0.0:1787365049.162687:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024414720 00000100:00100000:0.0:1787365049.162692:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024414720 00000100:00100000:0.0:1787365049.162782:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787365049.162790:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d1dd6e9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+6:5814:x1874188024414720:12345-0@lo:501: 00000100:00100000:0.0:1787365049.163045:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d1dd6e9e pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+6:5814:x1874188024414720:12345-0@lo:501: Request processed in 255us (481us total) trans 0 rc -2/-2 00000100:00100000:0.0:1787365049.163053:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787365049.163441:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7335282 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024414720:0@lo:501: 10000000:01000000:1.0:1787365049.163466:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787365049.163488:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000f2a5373f/0x872d29295eb46992 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46999 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.163497:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000f2a5373f/0x872d29295eb46992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46999 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365049.163506:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f2797a7c800 10000000:01000000:1.0:1787365049.163511:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787365049.163524:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f2797a7c800 10000000:01000000:1.0:1787365049.163527:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:1.0:1787365049.163530:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9f2797a7c800 from 1 10000000:01000000:1.0:1787365049.163540:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:1.0:1787365049.163563:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 0000000029c937e1/0x872d29295eb469a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.163571:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 0000000029c937e1/0x872d29295eb469a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.163578:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 0000000029c937e1/0x872d29295eb469a0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365049.163591:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7335282 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024414848:0@lo:101: 00000100:00100000:1.0:1787365049.163620:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365049.163917:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000000b05ce2 going to sleep for 11 seconds 00000100:00100000:3.0:1787365049.163988:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024414848 00000100:00100000:3.0:1787365049.163994:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024414848 00000100:00100000:3.0:1787365049.164020:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787365049.164027:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003eba082a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+6:5814:x1874188024414848:12345-0@lo:101: 00010000:00010000:3.0:1787365049.164036:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365049.164049:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000255ecf0e/0x872d29295eb469a7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb469a0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365049.164069:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000255ecf0e/0x872d29295eb469a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb469a0 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365049.164079:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000255ecf0e/0x872d29295eb469a7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb469a0 expref: 7 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365049.164098:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000255ecf0e, rc 0) 00000100:00100000:3.0:1787365049.164180:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003eba082a pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+7:5814:x1874188024414848:12345-0@lo:101: Request processed in 153us (559us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365049.164186:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787365049.164343:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7335282 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024414848:0@lo:101: 00010000:00010000:1.0:1787365049.164356:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 0000000029c937e1/0x872d29295eb469a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb469a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.164362:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 0000000029c937e1/0x872d29295eb469a0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb469a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365049.164376:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:1.0:1787365049.164389:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 0000000029c937e1/0x872d29295eb469a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb469a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.164396:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 0000000029c937e1/0x872d29295eb469a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb469a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365049.164402:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787365049.164405:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787365049.164418:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f2797a7c800 10000000:01000000:1.0:1787365049.164428:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:1.0:1787365049.164431:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:1.0:1787365049.164433:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787365049.164449:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000008b491e30/0x872d29295eb469ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.164454:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000008b491e30/0x872d29295eb469ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.164460:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000008b491e30/0x872d29295eb469ae lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365049.164470:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7335282 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024414976:0@lo:101: 00000100:00100000:1.0:1787365049.164496:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365049.164525:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000000b05ce2 going to sleep for 11 seconds 00000100:00100000:3.0:1787365049.164608:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024414976 00000100:00100000:3.0:1787365049.164612:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024414976 00000100:00100000:3.0:1787365049.164660:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787365049.164666:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004464cca8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+7:5814:x1874188024414976:12345-0@lo:101: 00010000:00010000:3.0:1787365049.164673:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365049.164680:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000cb5c9cb6/0x872d29295eb469b5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb469ae expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365049.164693:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000cb5c9cb6/0x872d29295eb469b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb469ae expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365049.164699:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000cb5c9cb6/0x872d29295eb469b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb469ae expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365049.164705:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000cb5c9cb6, rc 0) 00000100:00100000:3.0:1787365049.164730:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004464cca8 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+8:5814:x1874188024414976:12345-0@lo:101: Request processed in 65us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365049.164736:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787365049.164940:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7335282 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024414976:0@lo:101: 00010000:00010000:1.0:1787365049.164950:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000008b491e30/0x872d29295eb469ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb469b5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.164956:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000008b491e30/0x872d29295eb469ae lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb469b5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365049.164995:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7335282 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024415104:0@lo:501: 00000100:00100000:1.0:1787365049.165019:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365049.165133:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000000b05ce2 going to sleep for 11 seconds 00000100:00100000:2.0:1787365049.165186:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024415104 00000100:00100000:2.0:1787365049.165191:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024415104 00000100:00100000:3.0:1787365049.165232:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:3.0:1787365049.165329:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000076f27049 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+8:5814:x1874188024415104:12345-0@lo:501: 00000100:00100000:3.0:1787365049.165563:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000076f27049 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+9:5814:x1874188024415104:12345-0@lo:501: Request processed in 236us (543us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365049.165570:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787365049.165651:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7335282 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024415104:0@lo:501: 00000100:00100000:1.0:1787365049.165677:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7335282 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024415232:0@lo:503: 00000100:00100000:1.0:1787365049.165713:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365049.165745:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 0000000000b05ce2 going to sleep for 11 seconds 00000100:00100000:3.0:1787365049.165848:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024415232 00000100:00100000:3.0:1787365049.165852:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024415232 00000100:00100000:3.0:1787365049.165881:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787365049.165887:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000001c9cbe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+9:5814:x1874188024415232:12345-0@lo:503: 00000100:00100000:3.0:1787365049.166020:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000001c9cbe4 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+9:5814:x1874188024415232:12345-0@lo:503: Request processed in 134us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365049.166028:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787365049.166101:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7335282 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024415232:0@lo:503: 00000100:00100000:1.0:1787365049.168322:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d7335282 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:5856:1874188024415360:0@lo:502: 00000100:00100000:1.0:1787365049.168399:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365049.168449:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set 000000003e05b337 going to sleep for 11 seconds 00000100:00100000:3.0:1787365049.168564:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024415360 00000100:00100000:3.0:1787365049.168571:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024415360 00000100:00100000:3.0:1787365049.168620:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787365049.168646:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000051aa008c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+9:5856:x1874188024415360:12345-0@lo:502: 00000100:00100000:3.0:1787365049.168909:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000051aa008c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+9:5856:x1874188024415360:12345-0@lo:502: Request processed in 265us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365049.168917:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787365049.169906:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d7335282 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:5856:1874188024415360:0@lo:502: 00000020:01000000:0.0:1787365049.169946:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787365049.169958:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365049.169960:0:5856:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787365049.169966:0:5856:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787365049.169969:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787365049.169992:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (00000000e79e854c) 00000020:00000080:0.0:1787365049.170009:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787365049.170015:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787365049.170097:0:5856:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787365049.170104:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x872d29295eb469c3 00000020:00000080:0.0:1787365049.171309:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787365049.171316:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787365049.171322:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365049.171323:0:5856:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787365049.171326:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787365049.171331:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365049.171332:0:5856:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787365049.171335:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787365049.171344:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (00000000e820a861) 00000020:00000080:0.0:1787365049.171358:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787365049.171361:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787365049.171363:0:5856:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787365049.171365:0:5856:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787365049.171370:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787365049.171428:0:5856:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c39929c5 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787365049.171439:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (00000000b9ecdc10) 00000020:00000080:0.0:1787365049.171447:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787365049.171522:0:5856:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787365049.171530:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x872d29295eb469d8 00000020:00000080:0.0:1787365049.171672:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787365049.171678:0:5856:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787365049.171683:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x872d29295eb469df 00080000:01000000:0.0:1787365049.171689:0:5856:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787365049.171692:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x872d29295eb469e6 00080000:10000000:0.0:1787365049.172106:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 40000000:02000000:1.0:1787365049.176762:0:5856:0:(fid_handler.c:560:seq_server_init()) ctl-lustre-MDT0000: No data found on store. Initialize space. 40000000:02000000:0.0:1787365049.190756:0:5856:0:(fid_handler.c:560:seq_server_init()) srv-lustre-MDT0000: No data found on store. Initialize space. 00010000:00010000:2.0:1787365049.339548:0:5856:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:02000400:3.0:1787365049.344958:0:5856:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-MDT0000: new disk, initializing 00000001:00000004:3.0:1787365049.354159:0:5856:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 0 00000001:00080000:3.0:1787365049.354532:0:5856:0:(tgt_lastrcvd.c:240:tgt_reply_header_write()) lustre-MDT0000: write reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787365049.402823:0:5856:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (0000000050d1fe1f) 00000020:00000080:0.0:1787365049.402845:0:5856:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787365049.402922:0:5856:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787365049.402929:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x872d29295eb469f4 00000020:00000080:3.0:1787365049.406414:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00080000:10000000:3.0:1787365049.411109:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x10000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787365049.481213:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1010000:0x0] (8/8/4) registered 00080000:10000000:3.0:1787365049.531041:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2010000:0x0] (8/8/4) registered 00080000:10000000:2.0:1787365049.607171:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x20000:0x0] (8/8/4) registered 00080000:10000000:1.0:1787365049.687454:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x1020000:0x0] (8/8/4) registered 00010000:00010000:2.0:1787365049.718285:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:0.0:1787365049.800908:0:5856:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000006:0x2020000:0x0] (8/8/4) registered 00000020:00000080:2.0:1787365049.857781:0:5856:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x872d29295eb469fb 00000020:00000080:2.0:1787365049.858344:0:5856:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:2.0:1787365049.858355:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787365049.858361:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365049.858363:0:5856:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:2.0:1787365049.858366:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787365049.858370:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365049.858371:0:5856:0:(obd_config.c:1563:class_process_config()) marker 8 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787365049.858373:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787365049.858375:0:5856:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:2.0:1787365049.858377:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787365049.858380:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365049.858381:0:5856:0:(obd_config.c:1563:class_process_config()) marker 8 (0x2) lustre sys.timeout 00000020:01000000:2.0:1787365049.858383:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787365049.858394:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365049.858395:0:5856:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:2.0:1787365049.858400:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:2.0:1787365049.858435:0:5856:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000100:00100000:2.0:1787365049.858499:0:5856:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d801b38d pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:5856:1874188024415488:0@lo:502: 00000100:00100000:2.0:1787365049.859389:0:5856:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365049.859458:0:5856:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b37e30fb going to sleep for 11 seconds 00000100:00100000:3.0:1787365049.859697:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024415488 00000100:00100000:3.0:1787365049.859706:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024415488 00000100:00100000:3.0:1787365049.859753:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787365049.859761:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000616714fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+9:5856:x1874188024415488:12345-0@lo:502: 00000100:00100000:3.0:1787365049.860176:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000616714fb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+9:5856:x1874188024415488:12345-0@lo:502: Request processed in 415us (788us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365049.860185:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787365049.860382:0:5856:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d801b38d pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:5856:1874188024415488:0@lo:502: 00000020:01000000:0.0:1787365049.860422:0:5856:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787365049.860428:0:5856:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365049.860430:0:5856:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000040:00080000:0.0:1787365049.860434:0:5856:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 16 count 16 00000020:01000000:3.0:1787365049.860615:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-15 (rc=0) 10000000:01000000:3.0:1787365049.860750:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787365049.860798:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 000000008b491e30/0x872d29295eb469ae lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb469b5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365049.860808:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 000000008b491e30/0x872d29295eb469ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb469b5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365049.860815:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f2797a7c800 from 1 10000000:01000000:3.0:1787365049.860818:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787365049.860860:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 0000000026e040c1/0x872d29295eb46a02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365049.860867:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 0000000026e040c1/0x872d29295eb46a02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365049.860875:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 0000000026e040c1/0x872d29295eb46a02 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365049.860890:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008f6e5ef1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024415616:0@lo:101: 00000100:00100000:3.0:1787365049.860934:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365049.860969:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d915fced going to sleep for 11 seconds 00000100:00100000:1.0:1787365049.861030:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024415616 00000100:00100000:1.0:1787365049.861035:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024415616 00000100:00100000:1.0:1787365049.861070:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787365049.861076:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f2025cd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+9:5814:x1874188024415616:12345-0@lo:101: 00010000:00010000:1.0:1787365049.861086:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365049.861098:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000c73d8210/0x872d29295eb46a09 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46a02 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.861118:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000c73d8210/0x872d29295eb46a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46a02 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.861128:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000c73d8210/0x872d29295eb46a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46a02 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.861135:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000c73d8210, rc 0) 00000100:00100000:1.0:1787365049.861174:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f2025cd0 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+10:5814:x1874188024415616:12345-0@lo:101: Request processed in 98us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365049.861180:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787365049.861746:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008f6e5ef1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024415616:0@lo:101: 00010000:00010000:3.0:1787365049.861761:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 0000000026e040c1/0x872d29295eb46a02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46a09 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365049.861769:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 0000000026e040c1/0x872d29295eb46a02 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46a09 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365049.862405:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008f6e5ef1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024415744:0@lo:256: 00000100:00100000:3.0:1787365049.862463:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365049.862496:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d915fced going to sleep for 11 seconds 00000100:00100000:2.0:1787365049.862586:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024415744 00000100:00100000:2.0:1787365049.862592:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024415744 00000100:00100000:2.0:1787365049.862654:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787365049.862661:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000066b0d579 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+10:5814:x1874188024415744:12345-0@lo:256: 20000000:01000000:2.0:1787365049.862676:0:5827:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:2.0:1787365049.862681:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:2.0:1787365049.862744:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000066b0d579 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+10:5814:x1874188024415744:12345-0@lo:256: Request processed in 84us (281us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365049.862751:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787365049.863075:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008f6e5ef1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024415744:0@lo:256: 10000000:01000000:3.0:1787365049.864095:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:3.0:1787365049.864114:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 0000000026e040c1/0x872d29295eb46a02 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46a09 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365049.864313:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 0000000026e040c1/0x872d29295eb46a02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46a09 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365049.864321:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f2797a7c800 from 1 10000000:01000000:3.0:1787365049.864324:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787365049.864425:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 00000000135ab5aa/0x872d29295eb46a10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365049.864433:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 00000000135ab5aa/0x872d29295eb46a10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365049.864441:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 00000000135ab5aa/0x872d29295eb46a10 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365049.864458:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008f6e5ef1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024415872:0@lo:101: 00000100:00100000:3.0:1787365049.864504:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365049.864598:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d915fced going to sleep for 11 seconds 00000100:00100000:2.0:1787365049.864774:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024415872 00000100:00100000:2.0:1787365049.864782:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024415872 00000100:00100000:2.0:1787365049.864932:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787365049.864940:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007df7f199 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+10:5814:x1874188024415872:12345-0@lo:101: 00010000:00010000:2.0:1787365049.864951:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365049.864965:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 0000000014f36579/0x872d29295eb46a17 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46a10 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365049.864986:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 0000000014f36579/0x872d29295eb46a17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46a10 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365049.864995:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 0000000014f36579/0x872d29295eb46a17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46a10 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365049.865018:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 0000000014f36579, rc 0) 00000100:00100000:2.0:1787365049.865064:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007df7f199 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:5814:x1874188024415872:12345-0@lo:101: Request processed in 125us (561us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365049.865071:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787365049.865133:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008f6e5ef1 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024415872:0@lo:101: 00010000:00010000:0.0:1787365049.865145:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 00000000135ab5aa/0x872d29295eb46a10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46a17 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365049.865152:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 00000000135ab5aa/0x872d29295eb46a10 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46a17 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365049.865230:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d805d7ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024416000:0@lo:501: 00000100:00100000:0.0:1787365049.865257:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365049.865378:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd2860a1 going to sleep for 11 seconds 00000100:00100000:3.0:1787365049.865460:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024416000 00000100:00100000:3.0:1787365049.865465:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024416000 00000100:00100000:3.0:1787365049.865498:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787365049.865504:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000003e244ecb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:5814:x1874188024416000:12345-0@lo:501: 00000100:00100000:3.0:1787365049.869999:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000003e244ecb pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:5814:x1874188024416000:12345-0@lo:501: Request processed in 4487us (4733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365049.870028:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787365049.874996:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d805d7ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024416000:0@lo:501: 00000100:00100000:0.0:1787365049.875062:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d805d7ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024416128:0@lo:503: 00000100:00100000:0.0:1787365049.875139:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365049.875246:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024416128 00000100:00100000:1.0:1787365049.875253:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024416128 00000100:00100000:1.0:1787365049.875307:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787365049.875323:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004f96a709 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:5814:x1874188024416128:12345-0@lo:503: 00000040:00080000:1.0:1787365049.875383:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787365049.875431:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004f96a709 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:5814:x1874188024416128:12345-0@lo:503: Request processed in 110us (293us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365049.875438:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787365049.875600:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd2860a1 going to sleep for 11 seconds 00000100:00100000:0.0:1787365049.875613:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d805d7ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024416128:0@lo:503: 00000040:00080000:1.0:1787365049.877805:0:5860:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 1 00000020:01000000:0.0:1787365049.882068:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-0 (rc=0) 10000000:01000000:0.0:1787365049.882104:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787365049.882125:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 00000000135ab5aa/0x872d29295eb46a10 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46a17 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365049.882139:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 00000000135ab5aa/0x872d29295eb46a10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46a17 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365049.882302:0:5814:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787365049.882305:0:5814:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f2797a7c800 10000000:01000000:2.0:1787365049.882309:0:5814:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f2797a7c800 10000000:01000000:2.0:1787365049.882313:0:5814:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787365049.882318:0:5814:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f2797a7c800 from 1 10000000:01000000:2.0:1787365049.882321:0:5814:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787365049.882369:0:5814:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000000cc4eb5f/0x872d29295eb46a1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365049.882378:0:5814:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000000cc4eb5f/0x872d29295eb46a1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365049.882388:0:5814:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000000cc4eb5f/0x872d29295eb46a1e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365049.882409:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000a956e2d5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024416256:0@lo:101: 00000100:00100000:2.0:1787365049.882477:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365049.882539:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a20484a9 going to sleep for 11 seconds 00000100:00100000:1.0:1787365049.882678:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024416256 00000100:00100000:1.0:1787365049.882685:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024416256 00000100:00100000:1.0:1787365049.882729:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787365049.882738:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007416a5fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:5814:x1874188024416256:12345-0@lo:101: 00010000:00010000:1.0:1787365049.882751:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365049.882761:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000004f60c93b/0x872d29295eb46a25 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46a1e expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.882783:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000004f60c93b/0x872d29295eb46a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46a1e expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.882793:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000004f60c93b/0x872d29295eb46a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46a1e expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.882800:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000004f60c93b, rc 0) 00000100:00100000:1.0:1787365049.882852:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007416a5fa pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:5814:x1874188024416256:12345-0@lo:101: Request processed in 116us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365049.882860:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787365049.883165:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000a956e2d5 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024416256:0@lo:101: 00010000:00010000:0.0:1787365049.883180:0:5814:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000000cc4eb5f/0x872d29295eb46a1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46a25 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365049.883188:0:5814:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000000cc4eb5f/0x872d29295eb46a1e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46a25 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365049.883250:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d805d7ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024416384:0@lo:501: 00000100:00100000:0.0:1787365049.883279:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365049.883307:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd2860a1 going to sleep for 11 seconds 00000100:00100000:2.0:1787365049.883439:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024416384 00000100:00100000:2.0:1787365049.883444:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024416384 00000100:00100000:2.0:1787365049.883475:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787365049.883481:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e1c8c44f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:5814:x1874188024416384:12345-0@lo:501: 00000100:00100000:2.0:1787365049.883753:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e1c8c44f pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:5814:x1874188024416384:12345-0@lo:501: Request processed in 271us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365049.883770:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787365049.885462:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d805d7ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024416384:0@lo:501: 00000100:00100000:0.0:1787365049.885521:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000d805d7ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024416512:0@lo:503: 00000100:00100000:0.0:1787365049.885584:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365049.885618:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 00000000fd2860a1 going to sleep for 11 seconds 00000100:00100000:2.0:1787365049.886057:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024416512 00000100:00100000:2.0:1787365049.886063:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024416512 00000100:00100000:2.0:1787365049.886102:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787365049.886108:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000004253196 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:5814:x1874188024416512:12345-0@lo:503: 00000100:00100000:2.0:1787365049.886480:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000004253196 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:5814:x1874188024416512:12345-0@lo:503: Request processed in 372us (896us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365049.886488:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787365049.886656:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000d805d7ad pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024416512:0@lo:503: 00000100:00100000:1.0:1787365049.887186:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ab27c098 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:5861:1874188024416640:0@lo:502: 00000100:00100000:1.0:1787365049.887232:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365049.887265:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 000000008bc8023c going to sleep for 11 seconds 00000100:00100000:2.0:1787365049.887461:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024416640 00000100:00100000:2.0:1787365049.887467:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024416640 00000100:00100000:2.0:1787365049.887506:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787365049.887523:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000ef88b137 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:5861:x1874188024416640:12345-0@lo:502: 00000100:00100000:2.0:1787365049.887789:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000ef88b137 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:5861:x1874188024416640:12345-0@lo:502: Request processed in 267us (557us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365049.887797:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787365049.887942:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ab27c098 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:5861:1874188024416640:0@lo:502: 00000020:01000004:0.0:1787365049.888004:0:5861:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:0.0:1787365049.888028:0:5861:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (00000000ae8ac4b6) 00000020:00000080:0.0:1787365049.888048:0:5861:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type lwp with refcount 2 00000020:01000004:0.0:1787365049.888122:0:5861:0:(tgt_mount.c:153:server_get_mount()) get mount 00000000c39929c5 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787365049.888126:0:5861:0:(tgt_mount.c:187:server_put_mount()) put mount 00000000c39929c5 from lustre-MDT0000, refs=4 00000020:01000004:0.0:1787365049.888129:0:5861:0:(obd_mount.c:710:lustre_put_lsi()) put 00000000c39929c5 4 00010000:00080000:0.0:1787365049.888179:0:5861:0:(ldlm_lib.c:102:import_set_conn()) imp 0000000047bbace9@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1787365049.891802:0:5861:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-1 is initialized 00000020:00000080:2.0:1787365049.893663:0:5861:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:2.0:1787365049.893701:0:5861:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787365049.893715:0:5861:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x872d29295eb46a33 00000100:00080000:2.0:1787365049.893726:0:5861:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787365049.893731:0:5861:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000047bbace9 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1787365049.893764:0:5861:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@0000000096ab14e8 x1874188024416768/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787365049.893785:0:5861:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787365049.893964:0:5861:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eae2d191 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:5861:1874188024416896:0@lo:502: 00000100:00100000:2.0:1787365049.894047:0:5861:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365049.894094:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024416896 00000100:00100000:2.0:1787365049.894100:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024416896 00000100:00100000:2.0:1787365049.894137:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787365049.894145:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000f7a8b85d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:5861:x1874188024416896:12345-0@lo:502: 00000100:00100000:2.0:1787365049.898100:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000f7a8b85d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:5861:x1874188024416896:12345-0@lo:502: Request processed in 3951us (4048us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365049.898115:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787365049.898205:0:5861:0:(client.c:2715:ptlrpc_set_wait()) set 00000000b37e30fb going to sleep for 11 seconds 00000100:00100000:2.0:1787365049.898230:0:5861:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eae2d191 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:5861:1874188024416896:0@lo:502: 00000040:00080000:2.0:1787365049.898268:0:5861:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 21 count 21 00000100:00100000:0.0:1787365049.899648:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000096ab14e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874188024416768:0@lo:38: 00000100:00100000:0.0:1787365049.899725:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365049.899804:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024416768 00000100:00100000:0.0:1787365049.899812:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024416768 00000100:00100000:0.0:1787365049.899859:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787365049.899865:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000d805d7ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874188024416768:12345-0@lo:38: 00000100:00100000:0.0:1787365049.899915:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000d805d7ad pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874188024416768:12345-0@lo:38: Request processed in 49us (191us total) trans 0 rc -11/-11 00000100:00100000:0.0:1787365049.899922:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787365049.899955:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787365049.899962:0:3309:0:(import.c:65:import_set_state_nolock()) 0000000047bbace9 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:0.0:1787365049.899966:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:0.0:1787365049.899969:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000096ab14e8 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874188024416768:0@lo:38: 00000020:01000000:1.0:1787365049.902283:0:5814:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-20 (rc=0) 10000000:01000000:1.0:1787365049.902322:0:5814:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787365049.902731:0:5814:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 000000000cc4eb5f/0x872d29295eb46a1e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46a25 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.902744:0:5814:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 000000000cc4eb5f/0x872d29295eb46a1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46a25 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787365049.902799:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787365049.902802:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787365049.902803:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787365049.902804:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787365049.902805:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787365049.902806:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787365049.902808:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787365049.902809:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787365049.902810:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787365049.902811:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787365049.902812:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787365049.902814:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787365049.902817:0:5814:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020065 00000020:01000004:1.0:1787365049.902819:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787365049.902820:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787365049.902821:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787365049.902822:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787365049.902823:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787365049.903564:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787365049.903568:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787365049.903569:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787365049.903571:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787365049.903572:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787365049.903573:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787365049.903574:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787365049.903601:0:5814:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:1.0:1787365049.903618:0:5814:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000026c61f89 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024417024:0@lo:253: 00000100:00100000:2.0:1787365049.911904:0:5814:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365049.911984:0:5814:0:(client.c:2715:ptlrpc_set_wait()) set 000000007a77cdb1 going to sleep for 11 seconds 00000100:00100000:1.0:1787365049.913757:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024417024 00000100:00100000:1.0:1787365049.913771:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024417024 00000100:00100000:1.0:1787365049.913840:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787365049.913864:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000007b096f6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:5814:x1874188024417024:12345-0@lo:253: 20000000:01000000:1.0:1787365049.913901:0:5828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787365049.913915:0:5828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787365049.988492:0:5828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787365049.988546:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:2.0:1787365049.995322:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787365049.995341:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787365049.995365:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000ce66d7df/0x872d29295eb46a3a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365049.995385:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 00000000c73d8210/0x872d29295eb46a09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46a02 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365049.995392:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000ce66d7df/0x872d29295eb46a3a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365049.995436:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 00000000c73d8210/0x872d29295eb46a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46a02 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365049.995452:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 00000000c73d8210/0x872d29295eb46a09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46a02 expref: 12 pid: 5829 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365049.995464:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eae2d191 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874188024417152:0@lo:104: 00000100:00100000:2.0:1787365049.995546:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365049.995613:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set 000000004e018f3f going to sleep for 11 seconds 00000100:00100000:1.0:1787365049.995810:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024417152 00000100:00100000:1.0:1787365049.995818:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024417152 00000100:00100000:1.0:1787365049.995879:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787365049.995887:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000043ab4c41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:5849:x1874188024417152:12345-0@lo:104: 00010000:00010000:1.0:1787365049.995898:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 0000000026e040c1/0x872d29295eb46a02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46a09 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.995963:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787365049.995968:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000043ab4c41 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:5849:x1874188024417152:12345-0@lo:104: Request processed in 83us (423us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365049.995974:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787365049.995994:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365049.995999:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 0000000026e040c1/0x872d29295eb46a02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46a09 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.996007:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 0000000026e040c1 already unused, calling callback (00000000ec732ef9) 10000000:00010000:1.0:1787365049.996009:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 0000000026e040c1/0x872d29295eb46a02 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46a09 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.996017:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 0000000026e040c1/0x872d29295eb46a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46a09 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787365049.996022:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 0000000026e040c1/0x872d29295eb46a02 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46a09 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365049.996039:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787365049.996069:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 0000000026e040c1/0x872d29295eb46a02 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46a09 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.996075:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787365049.996087:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 0000000026e040c1/0x872d29295eb46a02 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46a09 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.996093:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 0000000026e040c1/0x872d29295eb46a02 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46a09 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.996109:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365049.996111:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365049.996112:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365049.996214:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000005d103fb3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024417280:0@lo:103: 00000100:00100000:0.0:1787365049.996259:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365049.996749:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eae2d191 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874188024417152:0@lo:104: 00010000:00010000:2.0:1787365049.996768:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000ce66d7df/0x872d29295eb46a3a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365049.997454:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024417280 00000100:00100000:1.0:1787365049.997460:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024417280 00010000:00010000:1.0:1787365049.997486:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 00000000c73d8210/0x872d29295eb46a09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46a02 expref: 13 pid: 5829 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365049.997526:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787365049.997534:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000018f31d7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:3311:x1874188024417280:12345-0@lo:103: 00010000:00010000:1.0:1787365049.997545:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365049.997549:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 00000000c73d8210/0x872d29295eb46a09 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46a02 expref: 13 pid: 5829 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.997559:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 00000000c73d8210/0x872d29295eb46a09 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46a02 expref: 13 pid: 5829 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.997576:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000c73d8210/0x872d29295eb46a09 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46a02 expref: 13 pid: 5829 timeout: 317 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.997598:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000ce66d7df/0x872d29295eb46a3a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.997606:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000ce66d7df/0x872d29295eb46a3a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787365049.997619:0:5818:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002279126s 00010000:00010000:1.0:1787365049.997646:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ce66d7df/0x872d29295eb46a3a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.997653:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000ce66d7df/0x872d29295eb46a3a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.997659:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000ce66d7df/0x872d29295eb46a3a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.997665:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000ce66d7df/0x872d29295eb46a3a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.997670:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000ce66d7df already unused, calling callback (0000000055e1ebc8) 00010000:00010000:1.0:1787365049.997673:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000ce66d7df/0x872d29295eb46a3a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.997680:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000ce66d7df/0x872d29295eb46a3a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.997695:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000ce66d7df/0x872d29295eb46a3a lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.997704:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365049.997753:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000018f31d7d pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:3311:x1874188024417280:12345-0@lo:103: Request processed in 220us (1493us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365049.997760:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787365049.997780:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000ce66d7df/0x872d29295eb46a3a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.997786:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000ce66d7df/0x872d29295eb46a3a lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365049.997791:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000ce66d7df/0x872d29295eb46a3a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365049.999326:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000005d103fb3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024417280:0@lo:103: 00000100:00100000:3.0:1787365050.014615:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000007b096f6c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:5814:x1874188024417024:12345-0@lo:253: Request processed in 100745us (102708us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365050.014665:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787365050.014850:0:5814:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000026c61f89 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:5814:1874188024417024:0@lo:253: 10000000:01000000:2.0:1787365050.014867:0:5814:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:2.0:1787365050.014869:0:5814:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:2.0:1787365050.014871:0:5814:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787365050.014872:0:5814:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787365050.014873:0:5814:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787365050.014874:0:5814:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787365050.014876:0:5814:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787365050.014877:0:5814:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787365050.014878:0:5814:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787365050.014879:0:5814:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787365050.014881:0:5814:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787365050.014882:0:5814:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787365050.014883:0:5814:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:2.0:1787365050.014895:0:5814:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:3.0:1787365050.024135:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:3.0:1787365050.025087:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:3.0:1787365050.025911:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:3.0:1787365050.026084:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:3.0:1787365050.026537:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:2.0:1787365050.027003:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:2.0:1787365050.027790:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:2.0:1787365050.028046:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:2.0:1787365050.028318:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:2.0:1787365050.028576:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:2.0:1787365050.028942:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:2.0:1787365050.029118:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 40000000:02000000:0.0:1787365050.092604:0:5814:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000200000400-0x0000000240000400]:0:mdt 00000040:01000000:2.0:1787365050.124788:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:3.0:1787365050.125094:0:5867:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000020:00080000:1.0:1787365050.128312:0:5866:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 0 00000020:00080000:1.0:1787365050.128318:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000040:01000000:2.0:1787365050.129242:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:2.0:1787365050.129491:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:2.0:1787365050.130151:0:5814:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:2.0:1787365050.130171:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:2.0:1787365050.130373:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787365050.131661:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:2.0:1787365050.132461:0:5814:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:3.0:1787365050.132834:0:5814:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00000040:00080000:3.0:1787365050.133134:0:5814:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00080000:10000000:3.0:1787365050.133359:0:5814:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x11:0x0] (8/8/4) registered 00100000:10000000:3.0:1787365050.134622:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_00: rc = 0 00100000:10000000:3.0:1787365050.134787:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_01: rc = 0 00100000:10000000:3.0:1787365050.134934:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_02: rc = 0 00100000:10000000:3.0:1787365050.135087:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_03: rc = 0 00100000:10000000:3.0:1787365050.135236:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_04: rc = 0 00100000:10000000:3.0:1787365050.135382:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_05: rc = 0 00100000:10000000:3.0:1787365050.135550:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_06: rc = 0 00100000:10000000:3.0:1787365050.135728:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_07: rc = 0 00100000:10000000:3.0:1787365050.135877:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_08: rc = 0 00100000:10000000:3.0:1787365050.136014:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_09: rc = 0 00100000:10000000:3.0:1787365050.136172:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_10: rc = 0 00100000:10000000:3.0:1787365050.136310:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_11: rc = 0 00100000:10000000:3.0:1787365050.136467:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_12: rc = 0 00100000:10000000:2.0:1787365050.138060:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_13: rc = 0 00100000:10000000:2.0:1787365050.138460:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_14: rc = 0 00100000:10000000:2.0:1787365050.138667:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_namespace_15: rc = 0 00100000:10000000:2.0:1787365050.139116:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_00: rc = 0 00100000:10000000:2.0:1787365050.139525:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_01: rc = 0 00100000:10000000:2.0:1787365050.139694:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_02: rc = 0 00100000:10000000:2.0:1787365050.140141:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_03: rc = 0 00100000:10000000:2.0:1787365050.140473:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_04: rc = 0 00100000:10000000:2.0:1787365050.140683:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_05: rc = 0 00100000:10000000:2.0:1787365050.141101:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_06: rc = 0 00100000:10000000:2.0:1787365050.141432:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_07: rc = 0 00100000:10000000:2.0:1787365050.141607:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_08: rc = 0 00100000:10000000:2.0:1787365050.141813:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_09: rc = 0 00100000:10000000:2.0:1787365050.142126:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_10: rc = 0 00100000:10000000:2.0:1787365050.142445:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_11: rc = 0 00100000:10000000:2.0:1787365050.142596:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_12: rc = 0 00100000:10000000:2.0:1787365050.142846:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_13: rc = 0 00100000:10000000:2.0:1787365050.142979:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_14: rc = 0 00100000:10000000:2.0:1787365050.143113:0:5814:0:(lfsck_lib.c:2686:lfsck_load_one_trace_file()) lustre-MDT0000-osd: unlink lfsck sub trace file lfsck_layout_15: rc = 0 00000001:00000004:2.0:1787365050.143529:0:5814:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000040:00080000:3.0:1787365050.180220:0:5867:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000001:00080000:2.0:1787365050.233079:0:5814:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:2.0:1787365050.233116:0:5814:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaab44194b988 00100000:10000000:2.0:1787365050.233133:0:5814:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000040:00080000:3.0:1787365050.235292:0:5867:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:3.0:1787365050.235437:0:5867:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:3.0:1787365050.235442:0:5867:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000020:01000004:3.0:1787365050.235926:0:5814:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:3.0:1787365050.235942:0:5814:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:3.0:1787365050.235953:0:5814:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:3.0:1787365050.235967:0:5814:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:2.0:1787365050.749656:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365051.762837:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365052.787813:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365053.810880:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787365054.666135:0:6109:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:2.0:1787365054.834959:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787365055.346799:0:37:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787365055.346814:0:37:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787365055.346819:0:37:0:(import.c:65:import_set_state_nolock()) 0000000047bbace9 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787365055.346836:0:37:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import 0000000047bbace9 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1787365055.346865:0:37:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@000000008c86b4a1 x1874188024417536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787365055.346913:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008c86b4a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874188024417536:0@lo:38: 00000100:00100000:0.0:1787365055.346965:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000ec2f19e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024417408:0@lo:400: 00000100:00100000:3.0:1787365055.349720:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365055.349720:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365055.349842:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024417536 00000100:00100000:3.0:1787365055.349854:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024417536 00000100:00100000:3.0:1787365055.349908:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787365055.349917:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000b2c92f9e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1874188024417536:12345-0@lo:38: 00010000:00080000:3.0:1787365055.349952:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 172 last 0 00000020:00000080:3.0:1787365055.349999:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x872d29295eb46a41 00000004:00100000:3.0:1787365055.350058:0:5835:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00100000:0.0:1787365055.350151:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024417408 00000100:00100000:0.0:1787365055.350158:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024417408 00000100:00100000:0.0:1787365055.350239:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787365055.350247:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000073045b09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:3312:x1874188024417408:12345-0@lo:400: 00000100:00100000:0.0:1787365055.350336:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000073045b09 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:3312:x1874188024417408:12345-0@lo:400: Request processed in 90us (628us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365055.350357:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:3.0:1787365055.350431:0:5835:0:(import.c:65:import_set_state_nolock()) 00000000d56b6c64 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787365055.350484:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000b2c92f9e pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874188024417536:12345-0@lo:38: Request processed in 567us (778us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365055.350491:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787365055.350696:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@000000008c86b4a1 x1874188024417536/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787365065 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787365055.350715:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 1 00000100:00080000:3.0:1787365055.350725:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787365055.350730:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787365055.350733:0:3309:0:(import.c:65:import_set_state_nolock()) 0000000047bbace9 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787365055.350740:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008c86b4a1 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874188024417536:0@lo:38: 00000100:00100000:0.0:1787365055.350991:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000ec2f19e0 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024417408:0@lo:400: 00010000:00010000:2.0:1787365055.858739:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787365055.860863:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:2.0:1787365055.860870:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f2797a7c800 from 3 10000000:01000000:2.0:1787365055.860875:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787365055.860927:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000006bb71e68/0x872d29295eb46a48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365055.860942:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000006bb71e68/0x872d29295eb46a48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365055.860954:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000006bb71e68/0x872d29295eb46a48 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365055.860980:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eae2d191 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024417664:0@lo:101: 00000100:00100000:2.0:1787365055.861065:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365055.861202:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c40cd717 going to sleep for 11 seconds 00000100:00100000:1.0:1787365055.861395:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024417664 00000100:00100000:1.0:1787365055.861402:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024417664 00000100:00100000:1.0:1787365055.861462:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787365055.861480:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000a8e69f88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:5832:x1874188024417664:12345-0@lo:101: 00010000:00010000:1.0:1787365055.861504:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365055.861522:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 00000000f7a58f49/0x872d29295eb46a4f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46a48 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365055.861549:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000f7a58f49/0x872d29295eb46a4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46a48 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365055.861559:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 00000000f7a58f49/0x872d29295eb46a4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46a48 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365055.861568:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 00000000f7a58f49, rc 0) 00000100:00100000:1.0:1787365055.861618:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000a8e69f88 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:5832:x1874188024417664:12345-0@lo:101: Request processed in 148us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365055.861649:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787365055.861812:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eae2d191 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024417664:0@lo:101: 00010000:00010000:2.0:1787365055.861828:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000006bb71e68/0x872d29295eb46a48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46a4f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365055.861837:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000006bb71e68/0x872d29295eb46a48 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46a4f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365055.861892:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eae2d191 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024417792:0@lo:256: 00000100:00100000:2.0:1787365055.861924:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365055.861954:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set 00000000c40cd717 going to sleep for 11 seconds 00000100:00100000:1.0:1787365055.861998:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024417792 00000100:00100000:1.0:1787365055.862002:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024417792 00000100:00100000:1.0:1787365055.862056:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787365055.862063:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000034932a7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:5832:x1874188024417792:12345-0@lo:256: 20000000:01000000:1.0:1787365055.862078:0:5829:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787365055.862094:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787365055.862097:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 3 00000100:00100000:1.0:1787365055.862188:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000034932a7d pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:5832:x1874188024417792:12345-0@lo:256: Request processed in 125us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365055.862207:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787365055.863379:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eae2d191 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024417792:0@lo:256: 10000000:01000000:2.0:1787365055.863441:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787365055.863452:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: 000000006bb71e68/0x872d29295eb46a48 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46a4f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365055.863463:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: 000000006bb71e68/0x872d29295eb46a48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46a4f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365056.882923:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365057.916844:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365058.933696:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787365059.449347:0:6312:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffee1189b0 20000000:00000080:0.0:1787365059.449372:0:6312:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f2784526c00 uarg=0000000000000000 20000000:01000000:0.0:1787365059.449413:0:6312:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:0.0:1787365059.449423:0:6312:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:0.0:1787365059.449429:0:6312:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:0.0:1787365059.449769:0:6312:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 20000000:02000000:0.0:1787365059.449784:0:6312:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Modifying parameter general.debug_raw_pointers=Y in log params 00000040:00080000:2.0:1787365059.461903:0:6312:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787365059.462213:0:6312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:2.0:1787365059.462282:0:6312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 112 off8528 00000040:00080000:2.0:1787365059.462338:0:6312:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 224 off8752 10000000:01000000:2.0:1787365059.462357:0:6312:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787365059.462378:0:6312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: 00000000b4c05ddc/0x872d29295eb46a56 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365059.462402:0:6312:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: 0000000014f36579/0x872d29295eb46a17 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46a10 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365059.462411:0:6312:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: 00000000b4c05ddc/0x872d29295eb46a56 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365059.462471:0:6312:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: 0000000014f36579/0x872d29295eb46a17 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46a10 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365059.462490:0:6312:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: 0000000014f36579/0x872d29295eb46a17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46a10 expref: 11 pid: 5827 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365059.462507:0:6312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000eae2d191 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6312:1874188024417920:0@lo:104: 00000100:00100000:2.0:1787365059.462601:0:6312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365059.462709:0:6312:0:(client.c:2715:ptlrpc_set_wait()) set 00000000cbddd52b going to sleep for 11 seconds 00000100:00100000:0.0:1787365059.463341:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024417920 00000100:00100000:0.0:1787365059.463354:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024417920 00000100:00100000:0.0:1787365059.463414:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787365059.463423:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000004b02895a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:6312:x1874188024417920:12345-0@lo:104: 00010000:00010000:0.0:1787365059.463441:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: 00000000135ab5aa/0x872d29295eb46a10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46a17 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365059.463533:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787365059.463538:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000004b02895a pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:6312:x1874188024417920:12345-0@lo:104: Request processed in 117us (939us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365059.463546:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787365059.463942:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365059.463949:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: 00000000135ab5aa/0x872d29295eb46a10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46a17 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365059.463957:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000135ab5aa already unused, calling callback (00000000ec732ef9) 10000000:00010000:0.0:1787365059.463961:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: 00000000135ab5aa/0x872d29295eb46a10 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46a17 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365059.463987:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: 00000000135ab5aa/0x872d29295eb46a10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46a17 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365059.463994:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: 00000000135ab5aa/0x872d29295eb46a10 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46a17 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365059.463999:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787365059.464048:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: 00000000135ab5aa/0x872d29295eb46a10 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46a17 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365059.464054:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787365059.464073:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: 00000000135ab5aa/0x872d29295eb46a10 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46a17 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365059.464079:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: 00000000135ab5aa/0x872d29295eb46a10 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46a17 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365059.464100:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365059.464101:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365059.464103:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365059.464116:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000054b2a6e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024418048:0@lo:103: 00000100:00100000:0.0:1787365059.464158:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365059.464441:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024418048 00000100:00100000:1.0:1787365059.464464:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024418048 00010000:00010000:1.0:1787365059.464492:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: 0000000014f36579/0x872d29295eb46a17 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46a10 expref: 12 pid: 5827 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365059.464525:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787365059.464531:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e9bbb8be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:3313:x1874188024418048:12345-0@lo:103: 00010000:00010000:1.0:1787365059.464545:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365059.464550:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: 0000000014f36579/0x872d29295eb46a17 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46a10 expref: 12 pid: 5827 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365059.464560:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: 0000000014f36579/0x872d29295eb46a17 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46a10 expref: 12 pid: 5827 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365059.464579:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: 00000000b4c05ddc/0x872d29295eb46a56 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365059.464601:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 00000000b4c05ddc/0x872d29295eb46a56 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365059.464617:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b4c05ddc/0x872d29295eb46a56 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365059.464651:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: 00000000b4c05ddc/0x872d29295eb46a56 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365059.464657:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: 00000000b4c05ddc/0x872d29295eb46a56 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365059.464663:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: 00000000b4c05ddc/0x872d29295eb46a56 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365059.464668:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock 00000000b4c05ddc already unused, calling callback (0000000055e1ebc8) 00010000:00010000:1.0:1787365059.464671:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: 00000000b4c05ddc/0x872d29295eb46a56 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365059.464678:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: 00000000b4c05ddc/0x872d29295eb46a56 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365059.464686:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: 00000000b4c05ddc/0x872d29295eb46a56 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365059.464697:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365059.464734:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e9bbb8be pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:3313:x1874188024418048:12345-0@lo:103: Request processed in 203us (575us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365059.464742:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787365059.464781:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000054b2a6e3 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024418048:0@lo:103: 00010000:00010000:2.0:1787365059.465855:0:6312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 0000000014f36579/0x872d29295eb46a17 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46a10 expref: 11 pid: 5827 timeout: 326 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365059.465875:0:6312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000eae2d191 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:6312:1874188024417920:0@lo:104: 00010000:00010000:2.0:1787365059.465897:0:6312:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: 00000000b4c05ddc/0x872d29295eb46a56 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365059.465906:0:6312:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: 00000000b4c05ddc/0x872d29295eb46a56 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365059.465911:0:6312:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: 00000000b4c05ddc/0x872d29295eb46a56 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365059.465917:0:6312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: 00000000b4c05ddc/0x872d29295eb46a56 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 6312 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365059.955160:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365060.466922:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012b7cb66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024418304:0@lo:400: 00000100:00100000:0.0:1787365060.467002:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365060.467058:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787365060.467065:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000008fafb279 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024418176:0@lo:400: 00000100:00100000:0.0:1787365060.467205:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365060.468281:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024418176 00000100:00100000:3.0:1787365060.468293:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024418176 00000100:00100000:0.0:1787365060.468313:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024418304 00000100:00100000:0.0:1787365060.468324:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024418304 00000100:00100000:3.0:1787365060.468354:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787365060.468363:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787365060.468367:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002c28987c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:3311:x1874188024418176:12345-0@lo:400: 00000100:00100000:0.0:1787365060.468375:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000e2573f11 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024418304:12345-0@lo:400: 00000100:00100000:0.0:1787365060.468491:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000e2573f11 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024418304:12345-0@lo:400: Request processed in 119us (1499us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365060.468500:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002c28987c pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:3311:x1874188024418176:12345-0@lo:400: Request processed in 136us (1293us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365060.468501:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787365060.468511:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787365060.468548:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000008fafb279 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024418176:0@lo:400: 00010000:00080000:0.0:1787365060.468563:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@0000000012b7cb66 x1874188024418304/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365060.468574:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012b7cb66 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024418304:0@lo:400: 00010000:00010000:0.0:1787365060.978971:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365062.003838:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787365062.131594:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787365062.131604:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f2797a7c800 from 1 10000000:01000000:1.0:1787365062.131611:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787365062.131694:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: 000000008072b553/0x872d29295eb46a5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365062.131709:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: 000000008072b553/0x872d29295eb46a5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365062.131721:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: 000000008072b553/0x872d29295eb46a5d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365062.131752:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003cb85479 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024418432:0@lo:101: 00000100:00100000:1.0:1787365062.131845:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365062.131916:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d945a3ec going to sleep for 11 seconds 00000100:00100000:3.0:1787365062.132220:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024418432 00000100:00100000:3.0:1787365062.132235:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024418432 00000100:00100000:3.0:1787365062.132308:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787365062.132317:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000002dc772b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:5832:x1874188024418432:12345-0@lo:101: 00010000:00010000:3.0:1787365062.132334:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365062.132352:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: 000000002a634146/0x872d29295eb46a64 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46a5d expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365062.132389:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: 000000002a634146/0x872d29295eb46a64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46a5d expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365062.132399:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: 000000002a634146/0x872d29295eb46a64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46a5d expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365062.132436:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock 000000002a634146, rc 0) 00000100:00100000:3.0:1787365062.132508:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000002dc772b1 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:5832:x1874188024418432:12345-0@lo:101: Request processed in 193us (664us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365062.132516:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787365062.132724:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003cb85479 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024418432:0@lo:101: 00010000:00010000:1.0:1787365062.132750:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: 000000008072b553/0x872d29295eb46a5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46a64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365062.132764:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: 000000008072b553/0x872d29295eb46a5d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46a64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365062.132948:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@000000003cb85479 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024418560:0@lo:501: 00000100:00100000:1.0:1787365062.132991:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365062.133103:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set 00000000d945a3ec going to sleep for 11 seconds 00000100:00100000:0.0:1787365062.133211:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024418560 00000100:00100000:0.0:1787365062.133219:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024418560 00000100:00100000:0.0:1787365062.133256:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787365062.133263:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@0000000068c43e38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:5832:x1874188024418560:12345-0@lo:501: 00000100:00100000:0.0:1787365062.133685:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@0000000068c43e38 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:5832:x1874188024418560:12345-0@lo:501: Request processed in 420us (691us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365062.133694:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787365062.133772:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@000000003cb85479 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024418560:0@lo:501: 00000100:00100000:0.0:1787365062.133828:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@0000000012b7cb66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024418688:0@lo:503: 00000100:00100000:0.0:1787365062.133879:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365062.133913:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set 000000001ecb25b0 going to sleep for 11 seconds 00000100:00100000:0.0:1787365062.133928:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024418688 00000100:00100000:0.0:1787365062.133932:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024418688 00000100:00100000:0.0:1787365062.133954:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787365062.133959:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@00000000093cd524 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:5832:x1874188024418688:12345-0@lo:503: 00000100:00100000:0.0:1787365062.134145:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@00000000093cd524 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:5832:x1874188024418688:12345-0@lo:503: Request processed in 185us (268us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365062.134152:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787365062.134653:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@0000000012b7cb66 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024418688:0@lo:503: 00000100:00100000:1.0:1787365062.136760:0:6468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@00000000b19b138f pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:6468:1874188024418816:0@lo:502: 00000100:00100000:1.0:1787365062.136834:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365062.136874:0:6468:0:(client.c:2715:ptlrpc_set_wait()) set 00000000a60c03df going to sleep for 11 seconds 00000100:00100000:0.0:1787365062.136948:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024418816 00000100:00100000:0.0:1787365062.136954:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024418816 00000100:00100000:0.0:1787365062.136989:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787365062.136996:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@000000008aa2bca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:6468:x1874188024418816:12345-0@lo:502: 00000100:00100000:0.0:1787365062.137198:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@000000008aa2bca5 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:6468:x1874188024418816:12345-0@lo:502: Request processed in 202us (364us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365062.137205:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787365062.137319:0:6468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@00000000b19b138f pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:6468:1874188024418816:0@lo:502: 00000020:01000000:0.0:1787365062.137344:0:6468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787365062.137353:0:6468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365062.137355:0:6468:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787365062.137363:0:6468:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f2797a7c800 00000020:00000080:0.0:1787365062.137364:0:6468:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787365062.137407:0:6468:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b54700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:6468:1874188024418944:0@lo:502: 00000100:00100000:0.0:1787365062.137451:0:6468:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365062.137473:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024418944 00000100:00100000:0.0:1787365062.137477:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024418944 00000100:00100000:0.0:1787365062.137498:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787365062.137503:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:6468:x1874188024418944:12345-0@lo:502: 00000100:00100000:0.0:1787365062.137577:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:6468:x1874188024418944:12345-0@lo:502: Request processed in 73us (126us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365062.137581:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787365062.137601:0:6468:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27aa9ce600 going to sleep for 11 seconds 00000100:00100000:0.0:1787365062.137609:0:6468:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b54700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:6468:1874188024418944:0@lo:502: 00000020:01000000:0.0:1787365062.137641:0:6468:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787365062.137644:0:6468:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365062.137645:0:6468:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787365062.137648:0:6468:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 00000020:01000000:0.0:1787365062.137698:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:0.0:1787365062.137715:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787365062.137725:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46a5d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46a64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365062.137736:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46a5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46a64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365063.027103:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365064.052153:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365065.074749:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365065.589041:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024419072:0@lo:400: 00000100:00100000:0.0:1787365065.589145:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365065.589218:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787365065.589241:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024419200:0@lo:400: 00000100:00100000:0.0:1787365065.589270:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365065.589311:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024419072 00000100:00100000:0.0:1787365065.589319:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024419072 00000100:00100000:0.0:1787365065.589375:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787365065.589384:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:3312:x1874188024419072:12345-0@lo:400: 00000100:00100000:0.0:1787365065.589453:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:3312:x1874188024419072:12345-0@lo:400: Request processed in 69us (309us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365065.589461:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787365065.589497:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024419200 00000100:00100000:0.0:1787365065.589501:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024419200 00000100:00100000:0.0:1787365065.589542:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787365065.589548:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024419200:12345-0@lo:400: 00000100:00100000:0.0:1787365065.589581:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b56680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024419200:12345-0@lo:400: Request processed in 34us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365065.589588:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:0.0:1787365065.589666:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f2786b56a00 x1874188024419200/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365081 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365065.589683:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024419200:0@lo:400: 00000100:00100000:0.0:1787365065.589694:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b54700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024419072:0@lo:400: 00000020:01000004:1.0:1787365065.794203:0:6677:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:1.0:1787365065.794207:0:6677:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:1.0:1787365065.794306:0:6677:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f27a01d6000 00000020:01000004:1.0:1787365065.794321:0:6677:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:1.0:1787365065.794332:0:6677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:1.0:1787365065.794343:0:6677:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9f27872b99b8) 00000020:00000080:1.0:1787365065.794357:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787365065.825076:0:6677:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787365065.825324:0:6677:0:(scrub.c:230:scrub_file_store()) lustre-OST0000: store scrub file: rc = 0 00100000:10000000:3.0:1787365065.851300:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787365065.855487:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787365065.855522:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787365065.855583:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787365065.855610:0:6677:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:2.0:1787365065.857309:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:2.0:1787365065.857322:0:6677:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:2.0:1787365065.857334:0:6677:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x872d29295eb46a72 00000020:01000004:2.0:1787365065.857342:0:6677:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:2.0:1787365065.857371:0:6677:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:2.0:1787365065.857374:0:6677:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:2.0:1787365065.857380:0:6677:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:2.0:1787365065.857384:0:6677:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:2.0:1787365065.857395:0:6677:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9f2786aa19b8) 00000020:00000080:2.0:1787365065.857420:0:6677:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type ost with refcount 2 00000100:00100000:2.0:1787365065.858731:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787365065.858885:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:2.0:1787365065.858891:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:2.0:1787365065.860579:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:2.0:1787365065.860589:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787365065.861030:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787365065.861037:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787365065.862423:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787365065.862747:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787365065.862753:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787365065.863971:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787365065.863979:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:3.0:1787365065.893424:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787365065.893889:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:3.0:1787365065.893896:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:3.0:1787365065.895165:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:3.0:1787365065.895176:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:3.0:1787365065.896498:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:3.0:1787365065.896516:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:3.0:1787365065.899007:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787365065.899185:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:3.0:1787365065.899339:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:3.0:1787365065.901189:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:3.0:1787365065.901202:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787365065.939099:0:6677:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787365065.939311:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787365065.939318:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:3.0:1787365065.940585:0:6677:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:3.0:1787365065.940594:0:6677:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:3.0:1787365065.941023:0:6677:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:3.0:1787365065.941045:0:6677:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:3.0:1787365065.941052:0:6677:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:0.0:1787365065.956719:0:6677:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787365065.956755:0:6677:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20062 00000020:01000004:0.0:1787365065.956759:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787365065.956761:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787365065.956763:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787365065.956764:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787365065.956766:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787365065.956767:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787365065.956768:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787365065.956770:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787365065.956772:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787365065.956774:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787365065.956779:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787365065.956783:0:6677:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020062 00000020:01000004:0.0:1787365065.956785:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787365065.956787:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787365065.956788:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787365065.956789:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787365065.956790:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787365065.956791:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787365065.956793:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787365065.956794:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787365065.956795:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787365065.956796:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787365065.956797:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787365065.956823:0:6677:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787365065.956841:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b54700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024419328:0@lo:253: 00000100:00100000:0.0:1787365065.956910:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365065.957037:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6b13900 going to sleep for 11 seconds 00000100:00100000:2.0:1787365065.957156:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024419328 00000100:00100000:2.0:1787365065.957164:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024419328 00000100:00100000:2.0:1787365065.957246:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787365065.957255:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:6677:x1874188024419328:12345-0@lo:253: 20000000:01000000:2.0:1787365065.957284:0:5827:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787365065.957287:0:5827:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0000, index=0 20000000:01000000:2.0:1787365065.957293:0:5827:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0000 to 0 20000000:01000000:2.0:1787365065.957296:0:5827:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0000 00000040:00080000:2.0:1787365065.958122:0:5827:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787365065.958269:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 20000000:01000000:2.0:1787365065.958280:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf001 obdfilter lustre-OST0000_UUID (null) (null) 00000040:00080000:2.0:1787365065.958302:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 128 off8544 20000000:01000000:2.0:1787365065.958306:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000 0xcf003 dev type f (null) 00000040:00080000:2.0:1787365065.958320:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 112 off8656 00000040:00080000:2.0:1787365065.958343:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8880 00000040:00080000:2.0:1787365065.958651:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 224 off11152 20000000:01000000:2.0:1787365065.958669:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:2.0:1787365065.958671:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:2.0:1787365065.958703:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 88 off11240 20000000:01000000:2.0:1787365065.958710:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:2.0:1787365065.958766:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 144 off11384 20000000:01000000:2.0:1787365065.958787:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc-MDT0000 0xcf003 lustre-OST0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:2.0:1787365065.958818:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 152 off11536 20000000:01000000:2.0:1787365065.958826:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787365065.958854:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 136 off11672 00000040:00080000:2.0:1787365065.958903:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11896 00000040:00080000:2.0:1787365065.959556:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].21, 224 off11952 20000000:01000000:2.0:1787365065.959572:0:5827:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:2.0:1787365065.959574:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:2.0:1787365065.959608:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].22, 88 off12040 20000000:01000000:2.0:1787365065.959616:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:2.0:1787365065.959731:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].23, 128 off12168 20000000:01000000:2.0:1787365065.959739:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0000-osc 0xcf003 lustre-OST0000_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:2.0:1787365065.959777:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].24, 144 off12312 20000000:01000000:2.0:1787365065.959785:0:5827:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0000_UUID 0 1 (null) 00000040:00080000:2.0:1787365065.959810:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].25, 128 off12440 00000040:00080000:2.0:1787365065.959837:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].26, 224 off12664 20000000:01000000:2.0:1787365065.959849:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:2.0:1787365065.959851:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:2.0:1787365065.959855:0:5827:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:2.0:1787365065.959865:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787365065.959868:0:5827:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:2.0:1787365065.959895:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:2.0:1787365065.959897:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787365065.960468:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 10 marker 8 1->4: lustre sys.timeout 20000000:01000000:1.0:1787365065.960521:0:6693:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 12 marker 8 2->4: lustre sys.timeout 00000040:00080000:1.0:1787365065.960578:0:6693:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 22 count 22 00000040:00080000:2.0:1787365065.960856:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 224 off12120 00000040:00080000:2.0:1787365065.960894:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 80 off12200 00000040:00080000:2.0:1787365065.960970:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 224 off12424 20000000:01000000:2.0:1787365065.960984:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:2.0:1787365065.960986:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 00000040:00080000:1.0:1787365065.961848:0:6694:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 5 count 5 00000040:00080000:2.0:1787365065.962092:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 224 off9104 00000040:00080000:2.0:1787365065.962128:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 80 off9184 00000040:00080000:2.0:1787365065.962179:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9408 20000000:01000000:2.0:1787365065.962190:0:5827:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:2.0:1787365065.962198:0:5827:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787365065.962580:0:6695:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 18 marker 9 1->4: lustre sys.timeout 20000000:01000000:1.0:1787365065.962621:0:6695:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 20 marker 9 2->4: lustre sys.timeout 00000040:00080000:1.0:1787365065.962757:0:6695:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 27 count 27 00000040:00080000:2.0:1787365065.963008:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].27, 224 off12888 00000040:00080000:2.0:1787365065.963046:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].28, 80 off12968 00000040:00080000:2.0:1787365065.963077:0:5827:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].29, 224 off13192 20000000:01000000:2.0:1787365065.963091:0:5827:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:2.0:1787365065.963093:0:5827:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:2.0:1787365065.963101:0:5827:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:2.0:1787365065.963119:0:5827:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f27a12cc200/0x872d29295eb46a80 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365065.963137:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f278f70ba00/0x872d29295eb46999 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46992 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365065.963145:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f278f70b000/0x872d29295eb469b5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb469ae expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365065.963151:0:5827:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f27a0f86c00/0x872d29295eb46a25 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46a1e expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365065.963158:0:5827:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f27a12cc200/0x872d29295eb46a80 lrc: 6/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365065.963194:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f27a0f86c00/0x872d29295eb46a25 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46a1e expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365065.963208:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f27a0f86c00/0x872d29295eb46a25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46a1e expref: 12 pid: 5829 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365065.963222:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1874188024419456:0@lo:104: 00000100:00100000:2.0:1787365065.963283:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787365065.963375:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f278f70b000/0x872d29295eb469b5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb469ae expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365065.963395:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f278f70b000/0x872d29295eb469b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb469ae expref: 12 pid: 5828 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365065.963417:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1874188024419584:0@lo:104: 00000100:00100000:2.0:1787365065.963444:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787365065.963652:0:5827:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f278f70ba00/0x872d29295eb46999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46992 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365065.963661:0:5827:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f278f70ba00/0x872d29295eb46999 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46992 expref: 12 pid: 5828 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365065.963670:0:5827:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1874188024419712:0@lo:104: 00000100:00100000:2.0:1787365065.963693:0:5827:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365065.963736:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024419456 00000100:00100000:1.0:1787365065.963743:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024419456 00000100:00100000:0.0:1787365065.963810:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024419584 00000100:00100000:0.0:1787365065.963815:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024419584 00000100:00100000:0.0:1787365065.963837:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787365065.963845:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+4:5827:x1874188024419456:12345-0@lo:104: 00010000:00010000:0.0:1787365065.963857:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46a1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46a25 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365065.963916:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787365065.963923:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+4:5827:x1874188024419456:12345-0@lo:104: Request processed in 79us (639us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365065.963930:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787365065.963946:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787365065.963952:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:5827:x1874188024419584:12345-0@lo:104: 00010000:00010000:0.0:1787365065.963959:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87e00/0x872d29295eb469ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb469b5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365065.964003:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787365065.964008:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31ca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:5827:x1874188024419584:12345-0@lo:104: Request processed in 57us (564us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365065.964015:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:0.0:1787365065.964034:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787365065.964040:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46a1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46a25 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365065.964047:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cc000 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:0.0:1787365065.964051:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46a1e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46a25 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365065.964059:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46a25 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365065.964066:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46a1e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46a25 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365065.964072:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787365065.964097:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46a1e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46a25 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365065.964104:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787365065.964119:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46a1e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46a25 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365065.964125:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46a1e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46a25 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365065.964147:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365065.964151:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87e00/0x872d29295eb469ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb469b5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365065.964156:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a0f87e00 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:0.0:1787365065.964159:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87e00/0x872d29295eb469ae lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb469b5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365065.964166:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87e00/0x872d29295eb469ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb469b5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365065.964172:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87e00/0x872d29295eb469ae lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb469b5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365065.964177:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787365065.964191:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87e00/0x872d29295eb469ae lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb469b5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365065.964197:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787365065.964203:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87e00/0x872d29295eb469ae lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb469b5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365065.964209:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87e00/0x872d29295eb469ae lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb469b5 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365065.964219:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365065.964221:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365065.964222:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365065.964240:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024419968:0@lo:103: 00000100:00100000:0.0:1787365065.964273:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365065.964303:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787365065.964309:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024419840:0@lo:103: 00000100:00100000:0.0:1787365065.964328:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365065.964356:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024419968 00000100:00100000:0.0:1787365065.964359:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024419968 00010000:00010000:0.0:1787365065.964376:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f278f70b000/0x872d29295eb469b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb469ae expref: 13 pid: 5828 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365065.964394:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024419840 00000100:00100000:0.0:1787365065.964397:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024419840 00010000:00010000:0.0:1787365065.964425:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f27a0f86c00/0x872d29295eb46a25 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46a1e expref: 14 pid: 5829 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365065.964438:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787365065.964444:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:3311:x1874188024419968:12345-0@lo:103: 00010000:00010000:0.0:1787365065.964453:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365065.964458:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f278f70b000/0x872d29295eb469b5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb469ae expref: 14 pid: 5828 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365065.964467:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f278f70b000/0x872d29295eb469b5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb469ae expref: 14 pid: 5828 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365065.964482:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365065.964512:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:3311:x1874188024419968:12345-0@lo:103: Request processed in 67us (238us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365065.964519:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787365065.964531:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787365065.964537:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:3311:x1874188024419840:12345-0@lo:103: 00010000:00010000:0.0:1787365065.964551:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365065.964557:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f27a0f86c00/0x872d29295eb46a25 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46a1e expref: 13 pid: 5829 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365065.964565:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f27a0f86c00/0x872d29295eb46a25 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46a1e expref: 13 pid: 5829 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365065.964574:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365065.964596:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b57b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:3311:x1874188024419840:12345-0@lo:103: Request processed in 59us (266us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365065.964602:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787365065.964656:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024419840:0@lo:103: 00000100:00100000:0.0:1787365065.964665:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b57800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024419968:0@lo:103: 00010000:00010000:3.0:1787365065.964738:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365065.964859:0:5827:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278fd37240 going to sleep for 11 seconds 00010000:00010000:2.0:1787365065.964874:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a0f86c00/0x872d29295eb46a25 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46a1e expref: 12 pid: 5829 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365065.964884:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31f100 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1874188024419456:0@lo:104: 00010000:00010000:2.0:1787365065.964893:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f278f70b000/0x872d29295eb469b5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb469ae expref: 11 pid: 5828 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365065.964903:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31ce00 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1874188024419584:0@lo:104: 00000100:00100000:1.0:1787365065.964958:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024419712 00000100:00100000:1.0:1787365065.964962:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024419712 00000100:00100000:1.0:1787365065.964980:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787365065.964986:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:5827:x1874188024419712:12345-0@lo:104: 00010000:00010000:1.0:1787365065.964993:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86400/0x872d29295eb46992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46999 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365065.965080:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787365065.965086:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31c000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:5827:x1874188024419712:12345-0@lo:104: Request processed in 101us (1392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365065.965092:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787365065.965145:0:5827:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31c700 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0000:MGS:5827:1874188024419712:0@lo:104: 00010000:00010000:2.0:1787365065.965165:0:5827:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f27a12cc200/0x872d29295eb46a80 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365065.965225:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365065.965230:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86400/0x872d29295eb46992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46999 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365065.965236:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a0f86400 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:3.0:1787365065.965254:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86400/0x872d29295eb46992 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46999 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365065.965261:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86400/0x872d29295eb46992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46999 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787365065.965268:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86400/0x872d29295eb46992 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46999 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365065.965274:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787365065.965344:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86400/0x872d29295eb46992 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46999 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365065.965350:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787365065.965378:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86400/0x872d29295eb46992 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46999 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365065.965385:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86400/0x872d29295eb46992 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46999 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365065.965411:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365065.965414:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365065.965415:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365065.965422:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787365065.965434:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024420096:0@lo:103: 00000100:00100000:3.0:1787365065.965463:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365065.965487:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024420096 00000100:00100000:3.0:1787365065.965491:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024420096 00010000:00010000:3.0:1787365065.965508:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f278f70ba00/0x872d29295eb46999 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46992 expref: 11 pid: 5828 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365065.965526:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787365065.965539:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:3313:x1874188024420096:12345-0@lo:103: 00010000:00010000:3.0:1787365065.965548:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365065.965552:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f278f70ba00/0x872d29295eb46999 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46992 expref: 11 pid: 5828 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365065.965561:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f278f70ba00/0x872d29295eb46999 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46992 expref: 11 pid: 5828 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365065.965573:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f278f70ba00/0x872d29295eb46999 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46992 expref: 11 pid: 5828 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365065.965584:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f27a12cc200/0x872d29295eb46a80 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365065.965592:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a12cc200/0x872d29295eb46a80 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365065.965605:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f27a12cc200/0x872d29295eb46a80 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365065.965612:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f27a12cc200/0x872d29295eb46a80 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365065.965618:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f27a12cc200/0x872d29295eb46a80 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365065.965662:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f27a12cc200/0x872d29295eb46a80 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365065.965668:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cc200 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365065.965672:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f27a12cc200/0x872d29295eb46a80 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365065.965685:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f27a12cc200/0x872d29295eb46a80 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365065.965697:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f27a12cc200/0x872d29295eb46a80 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365065.965706:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365065.965736:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+10:3313:x1874188024420096:12345-0@lo:103: Request processed in 198us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365065.965742:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787365065.965767:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024420096:0@lo:103: 00010000:00010000:2.0:1787365065.965836:0:5827:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f27a12cc200/0x872d29295eb46a80 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365065.965850:0:5827:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f27a12cc200/0x872d29295eb46a80 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365065.965856:0:5827:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a12cc200/0x872d29295eb46a80 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787365065.965869:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787365066.007323:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+9:6677:x1874188024419328:12345-0@lo:253: Request processed in 50061us (50404us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365066.007337:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787365066.007454:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b54700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024419328:0@lo:253: 10000000:01000000:0.0:1787365066.007468:0:6677:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787365066.007471:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787365066.007473:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787365066.007474:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787365066.007476:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0000_UUID 00000020:01000004:0.0:1787365066.007477:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787365066.007478:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787365066.007480:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787365066.007481:0:6677:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:0.0:1787365066.007483:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787365066.007484:0:6677:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787365066.007505:0:6677:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f27a01d6000 from lustre-OST0000 10000000:01000000:0.0:1787365066.007532:0:6677:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787365066.007535:0:6677:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787365066.007541:0:6677:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f27872bb370 local copy 10000000:01000000:0.0:1787365066.007545:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:0.0:1787365066.007579:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46a87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365066.007602:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46a87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365066.007612:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46a87 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365066.007664:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b54700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024420224:0@lo:101: 00000100:00100000:0.0:1787365066.007700:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365066.007758:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6b13b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787365066.007875:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024420224 00000100:00100000:1.0:1787365066.007882:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024420224 00000100:00100000:1.0:1787365066.007924:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787365066.007939:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+9:6677:x1874188024420224:12345-0@lo:101: 00010000:00010000:1.0:1787365066.007952:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365066.007964:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a0f87200/0x872d29295eb46a8e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46a87 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365066.007987:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a0f87200/0x872d29295eb46a8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46a87 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365066.007997:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a0f87200/0x872d29295eb46a8e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46a87 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365066.008007:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a0f87200, rc 0) 00000100:00100000:1.0:1787365066.008043:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+10:6677:x1874188024420224:12345-0@lo:101: Request processed in 105us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365066.008049:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787365066.008133:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b54700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024420224:0@lo:101: 00010000:00010000:2.0:1787365066.008146:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46a87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x872d29295eb46a8e expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.008155:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46a87 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x872d29295eb46a8e expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365066.008262:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024420352:0@lo:501: 00000100:00100000:2.0:1787365066.008290:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365066.008306:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27aaa9b900 going to sleep for 11 seconds 00000100:00100000:2.0:1787365066.008320:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024420352 00000100:00100000:2.0:1787365066.008324:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024420352 00000100:00100000:2.0:1787365066.008355:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787365066.008361:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+10:6677:x1874188024420352:12345-0@lo:501: 00000100:00100000:2.0:1787365066.008565:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+10:6677:x1874188024420352:12345-0@lo:501: Request processed in 204us (274us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787365066.008573:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787365066.008612:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024420352:0@lo:501: 10000000:01000000:2.0:1787365066.008662:0:6677:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787365066.008688:0:6677:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787365066.008693:0:6677:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46a87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x872d29295eb46a8e expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.008701:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46a87 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x872d29295eb46a8e expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.008707:0:6677:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46a87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x872d29295eb46a8e expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.008726:0:6677:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787365066.008742:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f27a01d6000 10000000:01000000:2.0:1787365066.008746:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787365066.008750:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9f27872bb370 10000000:01000000:2.0:1787365066.008753:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:2.0:1787365066.008756:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9f27872bb370 from 1 10000000:01000000:2.0:1787365066.008759:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:2.0:1787365066.008774:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc200/0x872d29295eb46a95 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.008782:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc200/0x872d29295eb46a95 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.008789:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc200/0x872d29295eb46a95 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365066.008800:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024420480:0@lo:101: 00000100:00100000:2.0:1787365066.008823:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365066.008851:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27aaa9b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787365066.008864:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024420480 00000100:00100000:2.0:1787365066.008868:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024420480 00000100:00100000:2.0:1787365066.008885:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787365066.008891:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+10:6677:x1874188024420480:12345-0@lo:101: 00010000:00010000:2.0:1787365066.008898:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365066.008907:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a12cda00/0x872d29295eb46a9c lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46a95 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.008921:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a12cda00/0x872d29295eb46a9c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46a95 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.008930:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a12cda00/0x872d29295eb46a9c lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46a95 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.008936:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cda00, rc 0) 00000100:00100000:2.0:1787365066.008964:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:6677:x1874188024420480:12345-0@lo:101: Request processed in 72us (140us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365066.008970:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787365066.008999:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024420480:0@lo:101: 00010000:00010000:2.0:1787365066.009009:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc200/0x872d29295eb46a95 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46a9c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.009017:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc200/0x872d29295eb46a95 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46a9c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365066.009029:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:2.0:1787365066.009037:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc200/0x872d29295eb46a95 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46a9c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.009054:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc200/0x872d29295eb46a95 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46a9c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365066.009060:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:2.0:1787365066.009064:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787365066.009067:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:2.0:1787365066.009069:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787365066.009083:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc800/0x872d29295eb46aa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.009090:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc800/0x872d29295eb46aa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.009097:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc800/0x872d29295eb46aa3 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365066.009107:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024420608:0@lo:101: 00000100:00100000:2.0:1787365066.009141:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365066.009154:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27aaa9b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787365066.009166:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024420608 00000100:00100000:2.0:1787365066.009170:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024420608 00000100:00100000:2.0:1787365066.009185:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787365066.009191:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:6677:x1874188024420608:12345-0@lo:101: 00010000:00010000:2.0:1787365066.009197:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365066.009204:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a12cd200/0x872d29295eb46aaa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46aa3 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.009217:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a12cd200/0x872d29295eb46aaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46aa3 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.009231:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a12cd200/0x872d29295eb46aaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46aa3 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.009237:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cd200, rc 0) 00000100:00100000:2.0:1787365066.009265:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:6677:x1874188024420608:12345-0@lo:101: Request processed in 74us (123us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365066.009271:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:2.0:1787365066.009301:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024420608:0@lo:101: 00010000:00010000:2.0:1787365066.009311:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc800/0x872d29295eb46aa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46aaa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.009319:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc800/0x872d29295eb46aa3 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46aaa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365066.009369:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024420736:0@lo:501: 00000100:00100000:2.0:1787365066.009393:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365066.009420:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27aaa9b300 going to sleep for 11 seconds 00000100:00100000:2.0:1787365066.009437:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024420736 00000100:00100000:2.0:1787365066.009441:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024420736 00000100:00100000:2.0:1787365066.009461:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787365066.009467:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:6677:x1874188024420736:12345-0@lo:501: 00010000:00010000:3.0:1787365066.009478:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365066.009488:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46a87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x872d29295eb46a8e expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365066.009498:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780031e00 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:3.0:1787365066.009502:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46a87 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x872d29295eb46a8e expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365066.009513:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46a87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x872d29295eb46a8e expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787365066.009521:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46a87 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x872d29295eb46a8e expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365066.009527:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787365066.009551:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46a87 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x872d29295eb46a8e expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365066.009568:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787365066.009588:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46a87 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x872d29295eb46a8e expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365066.009596:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46a87 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x872d29295eb46a8e expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365066.009611:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365066.009613:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365066.009615:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365066.009649:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:6677:x1874188024420736:12345-0@lo:501: Request processed in 181us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365066.009656:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024420864:0@lo:103: 00000100:00100000:2.0:1787365066.009660:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787365066.009701:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024420736:0@lo:501: 00000100:00100000:3.0:1787365066.009703:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365066.009737:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024420992:0@lo:503: 00000100:00100000:3.0:1787365066.009753:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024420864 00000100:00100000:3.0:1787365066.009758:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024420864 00000100:00100000:2.0:1787365066.009787:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365066.009795:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787365066.009805:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:3313:x1874188024420864:12345-0@lo:103: 00000100:00100000:2.0:1787365066.009807:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27aaa9b300 going to sleep for 11 seconds 00010000:00010000:3.0:1787365066.009818:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:2.0:1787365066.009824:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024420992 00000100:00100000:2.0:1787365066.009829:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024420992 00010000:00010000:3.0:1787365066.009833:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a0f87200/0x872d29295eb46a8e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x872d29295eb46a87 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365066.009847:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365066.009852:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787365066.009861:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:6677:x1874188024420992:12345-0@lo:503: 00000100:00100000:3.0:1787365066.009879:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:3313:x1874188024420864:12345-0@lo:103: Request processed in 76us (178us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365066.009887:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787365066.009916:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024420864:0@lo:103: 00000100:00100000:2.0:1787365066.010015:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:6677:x1874188024420992:12345-0@lo:503: Request processed in 155us (229us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365066.010022:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787365066.010246:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31c700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024420992:0@lo:503: 00000040:00080000:3.0:1787365066.010507:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787365066.010563:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024421120:0@lo:502: 00000100:00100000:3.0:1787365066.010594:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365066.010607:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b66d9600 going to sleep for 11 seconds 00000100:00100000:0.0:1787365066.010762:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024421120 00000100:00100000:0.0:1787365066.010768:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024421120 00000100:00100000:0.0:1787365066.010803:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787365066.010810:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:6677:x1874188024421120:12345-0@lo:502: 00000100:00100000:0.0:1787365066.010950:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:6677:x1874188024421120:12345-0@lo:502: Request processed in 140us (354us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365066.010956:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:3.0:1787365066.011205:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024421120:0@lo:502: 00000040:00080000:3.0:1787365066.011478:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:3.0:1787365066.011526:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:3.0:1787365066.011557:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:3.0:1787365066.011599:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:3.0:1787365066.011748:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:3.0:1787365066.011787:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:3.0:1787365066.011815:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024421248:0@lo:502: 00000100:00100000:3.0:1787365066.011854:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365066.011877:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b66d9600 going to sleep for 11 seconds 00000100:00100000:0.0:1787365066.011936:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024421248 00000100:00100000:0.0:1787365066.011942:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024421248 00000100:00100000:0.0:1787365066.012134:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:0.0:1787365066.012143:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:6677:x1874188024421248:12345-0@lo:502: 00000100:00100000:0.0:1787365066.012294:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:6677:x1874188024421248:12345-0@lo:502: Request processed in 151us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365066.012301:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787365066.012436:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024421248:0@lo:502: 00000040:00080000:3.0:1787365066.012531:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:3.0:1787365066.012541:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 7 count 8 00000020:01000000:2.0:1787365066.013309:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787365066.013318:0:6697:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787365066.013324:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365066.013326:0:6697:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787365066.013333:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787365066.013348:0:6697:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9f2786aa0000) 00000020:00000080:2.0:1787365066.013369:0:6697:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787365066.013374:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787365066.013442:0:6697:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f27a01d6000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787365066.013450:0:6697:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787365066.013456:0:6697:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x872d29295eb46ab8 00010000:00010000:2.0:1787365066.019086:0:6697:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:02000400:2.0:1787365066.019550:0:6697:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0000: new disk, initializing 00000001:00000004:3.0:1787365066.024492:0:6697:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787365066.025087:0:6697:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0000: No data found on store. Initialize space. 00080000:10000000:3.0:1787365066.032558:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787365066.033546:0:6697:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787365066.035084:0:6697:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:3.0:1787365066.035094:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787365066.035100:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365066.035102:0:6697:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:3.0:1787365066.035107:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787365066.035112:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365066.035113:0:6697:0:(obd_config.c:1563:class_process_config()) marker 15 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787365066.035116:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787365066.035136:0:6697:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787365066.035188:0:6697:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787365066.035191:0:6697:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365066.035193:0:6697:0:(obd_config.c:1563:class_process_config()) marker 15 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787365066.035196:0:6697:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:0.0:1787365066.035281:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-7 (rc=0) 10000000:01000000:0.0:1787365066.035310:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787365066.035440:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc800/0x872d29295eb46aa3 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46aaa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365066.035480:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc800/0x872d29295eb46aa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46aaa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365066.035489:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f27a01d6000 from 1 10000000:01000000:0.0:1787365066.035493:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787365066.035526:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46abf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365066.035534:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46abf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365066.035545:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46abf lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365066.035566:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024421376:0@lo:101: 00000100:00100000:0.0:1787365066.035644:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365066.035686:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6b139c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365066.035769:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024421376 00000100:00100000:3.0:1787365066.035776:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024421376 00000100:00100000:3.0:1787365066.035821:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787365066.035829:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:6677:x1874188024421376:12345-0@lo:101: 00010000:00010000:3.0:1787365066.035840:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365066.035852:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f278f70ba00/0x872d29295eb46ac6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46abf expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365066.035874:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f278f70ba00/0x872d29295eb46ac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46abf expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365066.035884:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f278f70ba00/0x872d29295eb46ac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46abf expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365066.035893:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f278f70ba00, rc 0) 00000100:00100000:3.0:1787365066.035927:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:6677:x1874188024421376:12345-0@lo:101: Request processed in 99us (302us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365066.035934:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787365066.036030:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024421376:0@lo:101: 00010000:00010000:0.0:1787365066.036043:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46abf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ac6 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365066.036052:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46abf lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46ac6 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365066.036244:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024421504:0@lo:501: 00000100:00100000:0.0:1787365066.036333:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365066.036356:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6b139c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787365066.036376:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024421504 00000100:00100000:0.0:1787365066.036380:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024421504 00000100:00100000:0.0:1787365066.036469:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:0.0:1787365066.036477:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:6677:x1874188024421504:12345-0@lo:501: 00000100:00100000:0.0:1787365066.036692:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:6677:x1874188024421504:12345-0@lo:501: Request processed in 214us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365066.036700:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787365066.036831:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b57800 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024421504:0@lo:501: 00000100:00100000:1.0:1787365066.036859:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024421632:0@lo:503: 00000100:00100000:1.0:1787365066.036894:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365066.036919:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278838f900 going to sleep for 11 seconds 00000100:00100000:0.0:1787365066.036964:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024421632 00000100:00100000:0.0:1787365066.036968:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024421632 00000100:00100000:0.0:1787365066.036995:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787365066.037000:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:6677:x1874188024421632:12345-0@lo:503: 00000100:00100000:0.0:1787365066.039704:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:6677:x1874188024421632:12345-0@lo:503: Request processed in 2695us (2801us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365066.039717:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787365066.040344:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024421632:0@lo:503: 00000040:00080000:1.0:1787365066.041492:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787365066.041746:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024421760:0@lo:502: 00000100:00100000:1.0:1787365066.041942:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365066.041982:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024421760 00000100:00100000:3.0:1787365066.041988:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024421760 00000100:00100000:1.0:1787365066.041993:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278838f900 going to sleep for 11 seconds 00000100:00100000:3.0:1787365066.042025:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:3.0:1787365066.042034:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:6677:x1874188024421760:12345-0@lo:502: 00000100:00100000:3.0:1787365066.042236:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:6677:x1874188024421760:12345-0@lo:502: Request processed in 202us (418us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365066.042244:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787365066.045544:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024421760:0@lo:502: 00000040:00080000:1.0:1787365066.045859:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:1.0:1787365066.045909:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:1.0:1787365066.045947:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024421888:0@lo:502: 00000100:00100000:1.0:1787365066.046006:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365066.046052:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278838f900 going to sleep for 11 seconds 00000100:00100000:0.0:1787365066.046235:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024421888 00000100:00100000:0.0:1787365066.046242:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024421888 00000100:00100000:0.0:1787365066.046344:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:0.0:1787365066.046353:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:6677:x1874188024421888:12345-0@lo:502: 00000100:00100000:0.0:1787365066.046555:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:6677:x1874188024421888:12345-0@lo:502: Request processed in 203us (549us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365066.046611:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024421888:0@lo:502: 00000040:00080000:1.0:1787365066.046700:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:1.0:1787365066.046710:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000100:00100000:0.0:1787365066.046890:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000020:01000000:0.0:1787365066.048554:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787365066.048567:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365066.048569:0:6701:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:0.0:1787365066.048575:0:6701:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f27a01d6000 00000020:00000080:0.0:1787365066.048578:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:0.0:1787365066.048598:0:6701:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787365066.048601:0:6701:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365066.048603:0:6701:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:0.0:1787365066.048612:0:6701:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:1.0:1787365066.050108:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:1.0:1787365066.050154:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787365066.050207:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46abf lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ac6 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365066.050219:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46abf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ac6 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365066.050265:0:6677:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:1.0:1787365066.050267:0:6677:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f27a01d6000 10000000:01000000:1.0:1787365066.050270:0:6677:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f27a01d6000 10000000:01000000:1.0:1787365066.050337:0:6677:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787365066.050343:0:6677:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f27a01d6000 from 1 10000000:01000000:1.0:1787365066.050346:0:6677:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:1.0:1787365066.050381:0:6677:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46acd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365066.050389:0:6677:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46acd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365066.050478:0:6677:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46acd lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365066.050505:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024422016:0@lo:101: 00000100:00100000:1.0:1787365066.050580:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365066.050648:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278838ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787365066.050649:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024422016 00000100:00100000:3.0:1787365066.050662:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024422016 00000100:00100000:3.0:1787365066.050902:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787365066.050913:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:6677:x1874188024422016:12345-0@lo:101: 00010000:00010000:3.0:1787365066.050925:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365066.050937:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f278f70a800/0x872d29295eb46ad4 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46acd expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365066.050960:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f278f70a800/0x872d29295eb46ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46acd expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365066.050971:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f278f70a800/0x872d29295eb46ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46acd expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365066.050980:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f278f70a800, rc 0) 00000100:00100000:3.0:1787365066.051020:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:6677:x1874188024422016:12345-0@lo:101: Request processed in 110us (439us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365066.051027:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787365066.051057:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024422016:0@lo:101: 00010000:00010000:1.0:1787365066.051072:0:6677:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46acd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ad4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365066.051081:0:6677:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46acd lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46ad4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365066.051165:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024422144:0@lo:501: 00000100:00100000:1.0:1787365066.051192:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365066.051255:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278838ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787365066.051348:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024422144 00000100:00100000:0.0:1787365066.051352:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024422144 00000100:00100000:0.0:1787365066.051388:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787365066.051396:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:6677:x1874188024422144:12345-0@lo:501: 00000100:00100000:0.0:1787365066.051873:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:6677:x1874188024422144:12345-0@lo:501: Request processed in 477us (678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365066.051881:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787365066.051951:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024422144:0@lo:501: 00000100:00100000:1.0:1787365066.051980:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024422272:0@lo:503: 00000100:00100000:1.0:1787365066.052017:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365066.052046:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278838ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787365066.052062:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024422272 00000100:00100000:3.0:1787365066.052068:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024422272 00000100:00100000:3.0:1787365066.052095:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:3.0:1787365066.052101:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:6677:x1874188024422272:12345-0@lo:503: 00000100:00100000:3.0:1787365066.052258:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:6677:x1874188024422272:12345-0@lo:503: Request processed in 156us (240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365066.052266:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787365066.052361:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024422272:0@lo:503: 00000040:00080000:1.0:1787365066.052838:0:6677:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787365066.052900:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024422400:0@lo:502: 00000100:00100000:1.0:1787365066.052939:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365066.052962:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278838ff00 going to sleep for 11 seconds 00000100:00100000:2.0:1787365066.053079:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024422400 00000100:00100000:2.0:1787365066.053084:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024422400 00000100:00100000:2.0:1787365066.053109:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787365066.053116:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:6677:x1874188024422400:12345-0@lo:502: 00000100:00100000:2.0:1787365066.053715:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:6677:x1874188024422400:12345-0@lo:502: Request processed in 598us (774us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365066.053723:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:3.0:1787365066.053930:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024422400:0@lo:502: 00000040:00080000:3.0:1787365066.054185:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:3.0:1787365066.054235:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:3.0:1787365066.054340:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:3.0:1787365066.054479:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:3.0:1787365066.054520:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:3.0:1787365066.054569:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:3.0:1787365066.054605:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:3.0:1787365066.054861:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:3.0:1787365066.054923:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:3.0:1787365066.054968:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:3.0:1787365066.055001:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:3.0:1787365066.055058:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:3.0:1787365066.055098:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:3.0:1787365066.055132:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:3.0:1787365066.055189:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:3.0:1787365066.055228:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:3.0:1787365066.055261:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:3.0:1787365066.055386:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:3.0:1787365066.055438:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:3.0:1787365066.055475:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:3.0:1787365066.055524:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:3.0:1787365066.055558:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:3.0:1787365066.055590:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:3.0:1787365066.055916:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:3.0:1787365066.055957:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:3.0:1787365066.055989:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:3.0:1787365066.056035:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:3.0:1787365066.056070:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000100:00100000:3.0:1787365066.056111:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024422528:0@lo:502: 00000100:00100000:3.0:1787365066.056177:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365066.056257:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473f540 going to sleep for 11 seconds 00000100:00100000:0.0:1787365066.056357:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024422528 00000100:00100000:0.0:1787365066.056364:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024422528 00000100:00100000:0.0:1787365066.056449:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787365066.056459:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:6677:x1874188024422528:12345-0@lo:502: 00000100:00100000:0.0:1787365066.057687:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:6677:x1874188024422528:12345-0@lo:502: Request processed in 1224us (1505us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365066.057698:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f0700 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024422528:0@lo:502: 00000100:00100000:0.0:1787365066.057700:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000040:00080000:3.0:1787365066.057807:0:6677:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:3.0:1787365066.057818:0:6677:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 29 count 30 00000020:01000004:0.0:1787365066.058379:0:6702:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:0.0:1787365066.058394:0:6702:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9f27bbec0000) 00000020:00000080:0.0:1787365066.058431:0:6702:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type lwp with refcount 2 00000020:01000004:0.0:1787365066.058620:0:6702:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f27a01d6000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787365066.058645:0:6702:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f27a01d6000 from lustre-OST0000, refs=3 00000020:01000004:0.0:1787365066.058648:0:6702:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f27a01d6000 3 00010000:00080000:0.0:1787365066.058877:0:6702:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f2684c5a800@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.113@tcp at head 00010000:00010000:0.0:1787365066.061363:0:6702:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-2 is initialized 00000020:00000080:0.0:1787365066.061789:0:6702:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:0.0:1787365066.061822:0:6702:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:0.0:1787365066.061834:0:6702:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x872d29295eb46ae2 00000100:00080000:0.0:1787365066.061843:0:6702:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787365066.061848:0:6702:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f2684c5a800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:0.0:1787365066.061882:0:6702:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f2786b56a00 x1874188024422656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:0.0:1787365066.061924:0:6702:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00100000:3.0:1787365066.062111:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874188024422656:0@lo:38: 00000100:00100000:1.0:1787365066.062152:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024422784:0@lo:400: 00000100:00100000:3.0:1787365066.062178:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365066.062210:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365066.062261:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024422656 00000100:00100000:1.0:1787365066.062267:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024422656 00000100:00100000:1.0:1787365066.062300:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024422784 00000100:00100000:1.0:1787365066.062309:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024422784 00000100:00100000:1.0:1787365066.062338:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787365066.062347:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024422784:12345-0@lo:400: 00000100:00100000:3.0:1787365066.062363:0:5834:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:3.0:1787365066.062372:0:5834:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:1.0:1787365066.062414:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787322d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024422784:12345-0@lo:400: Request processed in 66us (204us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365066.062421:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787365066.062436:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787365066.062440:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1874188024422656:12345-0@lo:38: 00010000:00080000:1.0:1787365066.062459:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 183 last 0 00000020:00000080:1.0:1787365066.062498:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x872d29295eb46ae9 00000004:00100000:1.0:1787365066.062512:0:5835:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00010000:00080000:3.0:1787365066.062539:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f2787321500 x1874188024422784/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365082 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787365066.062540:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9f27bf09c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787365066.062555:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787321500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024422784:0@lo:400: 00000100:00100000:1.0:1787365066.062591:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874188024422656:12345-0@lo:38: Request processed in 147us (411us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365066.062599:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787365066.062600:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f2786b56a00 x1874188024422656/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787365076 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365066.062610:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787365066.062616:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 1 00000100:00080000:3.0:1787365066.062654:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787365066.062659:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787365066.062662:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9f2684c5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787365066.062669:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b56a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874188024422656:0@lo:38: 00000040:00080000:1.0:1787365066.063334:0:6702:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000020:01000000:0.0:1787365066.063718:0:6677:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-29 (rc=0) 10000000:01000000:0.0:1787365066.063740:0:6677:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787365066.063753:0:6677:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46acd lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ad4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365066.063763:0:6677:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46acd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ad4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:0.0:1787365066.063802:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:0.0:1787365066.063804:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787365066.063806:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787365066.063808:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787365066.063809:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787365066.063810:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787365066.063812:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787365066.063813:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787365066.063815:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787365066.063817:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787365066.063818:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787365066.063822:0:6677:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020062 00000020:01000004:0.0:1787365066.063824:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787365066.063826:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787365066.063827:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787365066.063828:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787365066.063829:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787365066.063830:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787365066.063831:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787365066.063833:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787365066.063833:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787365066.063835:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787365066.063836:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:0.0:1787365066.063853:0:6677:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:0.0:1787365066.063866:0:6677:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b55500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024422912:0@lo:253: 00000100:00100000:0.0:1787365066.064388:0:6677:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365066.064436:0:6677:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27893ac9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365066.064486:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024422912 00000100:00100000:1.0:1787365066.064492:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024422912 00000100:00100000:1.0:1787365066.064533:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787365066.064542:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:6677:x1874188024422912:12345-0@lo:253: 20000000:01000000:1.0:1787365066.064565:0:5828:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787365066.064577:0:5828:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787365066.086281:0:5828:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787365066.086302:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787365066.086394:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787365066.086408:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787365066.086430:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f2780031800/0x872d29295eb46af0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365066.086447:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f27a0f86200/0x872d29295eb46a4f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46a48 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365066.086455:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f2780031800/0x872d29295eb46af0 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365066.086492:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f27a0f86200/0x872d29295eb46a4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46a48 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365066.086506:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f27a0f86200/0x872d29295eb46a4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46a48 expref: 13 pid: 5828 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365066.086520:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b56d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874188024423040:0@lo:104: 00000100:00100000:0.0:1787365066.086577:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365066.086704:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024423040 00000100:00100000:1.0:1787365066.086716:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024423040 00000100:00100000:1.0:1787365066.086796:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787365066.086806:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:5849:x1874188024423040:12345-0@lo:104: 00010000:00010000:1.0:1787365066.086829:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46a48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46a4f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365066.086885:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787365066.086891:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:5849:x1874188024423040:12345-0@lo:104: Request processed in 88us (314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365066.086899:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:2.0:1787365066.086904:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787365066.086914:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46a48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46a4f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.086923:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cc400 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:2.0:1787365066.086927:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46a48 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46a4f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.086936:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46a48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46a4f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787365066.086945:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46a48 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46a4f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365066.086950:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27893ac840 going to sleep for 11 seconds 10000000:01000000:2.0:1787365066.086951:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00000100:00100000:0.0:1787365066.086974:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b56d80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874188024423040:0@lo:104: 00010000:00010000:2.0:1787365066.086986:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46a48 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46a4f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.086993:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787365066.086995:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f2780031800/0x872d29295eb46af0 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.087013:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46a48 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46a4f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.087021:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46a48 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46a4f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.087038:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365066.087040:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365066.087043:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365066.087064:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024423168:0@lo:103: 00000100:00100000:2.0:1787365066.087113:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365066.087161:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024423168 00000100:00100000:2.0:1787365066.087171:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024423168 00010000:00010000:2.0:1787365066.087202:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f27a0f86200/0x872d29295eb46a4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46a48 expref: 14 pid: 5828 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365066.087228:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787365066.087235:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e1b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:3311:x1874188024423168:12345-0@lo:103: 00010000:00010000:2.0:1787365066.087245:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365066.087251:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f27a0f86200/0x872d29295eb46a4f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46a48 expref: 14 pid: 5828 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.087262:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f27a0f86200/0x872d29295eb46a4f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46a48 expref: 14 pid: 5828 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.087276:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a0f86200/0x872d29295eb46a4f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46a48 expref: 14 pid: 5828 timeout: 333 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.087288:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f2780031800/0x872d29295eb46af0 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.087297:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2780031800/0x872d29295eb46af0 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787365066.087307:0:5819:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.002279126s 00010000:00010000:2.0:1787365066.087311:0:5819:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f2780031800/0x872d29295eb46af0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.087318:0:5819:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f2780031800/0x872d29295eb46af0 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.087326:0:5819:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f2780031800/0x872d29295eb46af0 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.087342:0:5819:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f2780031800/0x872d29295eb46af0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.087347:0:5819:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780031800 already unused, calling callback (ffffffffc1672420) 00010000:00010000:2.0:1787365066.087351:0:5819:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f2780031800/0x872d29295eb46af0 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.087359:0:5819:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f2780031800/0x872d29295eb46af0 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.087373:0:5819:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f2780031800/0x872d29295eb46af0 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365066.087381:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365066.087426:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e1b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:3311:x1874188024423168:12345-0@lo:103: Request processed in 191us (313us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365066.087436:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00010000:0.0:1787365066.087452:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f2780031800/0x872d29295eb46af0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365066.087462:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f2780031800/0x872d29295eb46af0 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365066.087468:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2780031800/0x872d29295eb46af0 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365066.087529:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024423168:0@lo:103: 00000100:00100000:1.0:1787365066.093130:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:6677:x1874188024422912:12345-0@lo:253: Request processed in 28580us (28734us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365066.093145:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787365066.093389:0:6677:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b55500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:6677:1874188024422912:0@lo:253: 10000000:01000000:0.0:1787365066.093416:0:6677:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:0.0:1787365066.093420:0:6677:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:0.0:1787365066.093421:0:6677:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:0.0:1787365066.093423:0:6677:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787365066.093424:0:6677:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787365066.093426:0:6677:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787365066.093427:0:6677:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787365066.093428:0:6677:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:0.0:1787365066.093429:0:6677:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:0.0:1787365066.093431:0:6677:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:0.0:1787365066.093432:0:6677:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787365066.093434:0:6677:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:0.0:1787365066.093448:0:6677:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00010000:00010000:3.0:1787365066.098885:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00080000:10000000:1.0:1787365066.100018:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787365066.100188:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787365066.100355:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787365066.100514:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787365066.100708:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787365066.100874:0:6677:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:3.0:1787365066.102036:0:6677:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00080000:1.0:1787365066.325423:0:6677:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787365066.325429:0:6677:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:1.0:1787365066.325456:0:6677:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:1.0:1787365066.325511:0:6677:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:1.0:1787365066.325529:0:6677:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:1.0:1787365066.325557:0:6677:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787365067.132338:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365068.154407:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365069.172190:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787365069.559876:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:3.0:1787365069.559884:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f2797a7c800 from 21 10000000:01000000:3.0:1787365069.559890:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787365069.559936:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f278f70ae00/0x872d29295eb46af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365069.559948:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f278f70ae00/0x872d29295eb46af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365069.559975:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f278f70ae00/0x872d29295eb46af7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365069.559998:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024423296:0@lo:101: 00000100:00100000:3.0:1787365069.560064:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365069.560120:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473f900 going to sleep for 11 seconds 00000100:00100000:3.0:1787365069.560172:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024423296 00000100:00100000:3.0:1787365069.560180:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024423296 00000100:00100000:3.0:1787365069.560225:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787365069.560234:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:5832:x1874188024423296:12345-0@lo:101: 00010000:00010000:3.0:1787365069.560246:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365069.560259:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f278f70aa00/0x872d29295eb46afe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46af7 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365069.560281:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f278f70aa00/0x872d29295eb46afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46af7 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365069.560290:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f278f70aa00/0x872d29295eb46afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46af7 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365069.560299:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f278f70aa00, rc 0) 00000100:00100000:3.0:1787365069.560335:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:5832:x1874188024423296:12345-0@lo:101: Request processed in 103us (272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365069.560341:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:3.0:1787365069.560397:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024423296:0@lo:101: 00010000:00010000:3.0:1787365069.560411:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f278f70ae00/0x872d29295eb46af7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46afe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365069.560430:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f278f70ae00/0x872d29295eb46af7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46afe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365069.560480:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024423424:0@lo:501: 00000100:00100000:3.0:1787365069.560505:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365069.560521:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473f900 going to sleep for 11 seconds 00000100:00100000:3.0:1787365069.560534:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024423424 00000100:00100000:3.0:1787365069.560538:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024423424 00000100:00100000:3.0:1787365069.560558:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787365069.560564:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:5832:x1874188024423424:12345-0@lo:501: 00000100:00100000:3.0:1787365069.560900:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:5832:x1874188024423424:12345-0@lo:501: Request processed in 335us (393us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365069.560908:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787365069.560939:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024423424:0@lo:501: 00000100:00100000:3.0:1787365069.561829:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024423552:0@lo:503: 00000100:00100000:3.0:1787365069.561875:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365069.561900:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473f900 going to sleep for 11 seconds 00000100:00100000:3.0:1787365069.561916:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024423552 00000100:00100000:3.0:1787365069.561920:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024423552 00000100:00100000:3.0:1787365069.561946:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:3.0:1787365069.561952:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:5832:x1874188024423552:12345-0@lo:503: 00000100:00100000:3.0:1787365069.563439:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:5832:x1874188024423552:12345-0@lo:503: Request processed in 1481us (1558us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365069.563450:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:2.0:1787365069.564815:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f2680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024423552:0@lo:503: 00000100:00100000:3.0:1787365069.566372:0:6864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:6864:1874188024423680:0@lo:502: 00000100:00100000:3.0:1787365069.566458:0:6864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365069.566490:0:6864:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473f540 going to sleep for 11 seconds 00000100:00100000:0.0:1787365069.566549:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024423680 00000100:00100000:0.0:1787365069.566554:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024423680 00000100:00100000:0.0:1787365069.566599:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787365069.566606:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:6864:x1874188024423680:12345-0@lo:502: 00000100:00100000:0.0:1787365069.567021:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:6864:x1874188024423680:12345-0@lo:502: Request processed in 415us (563us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365069.567030:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:2.0:1787365069.567943:0:6864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f3800 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:6864:1874188024423680:0@lo:502: 00000100:00100000:2.0:1787365069.568003:0:6864:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:6864:1874188024423808:0@lo:502: 00000100:00100000:2.0:1787365069.568050:0:6864:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365069.568084:0:6864:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6af7b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787365069.568236:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024423808 00000100:00100000:3.0:1787365069.568241:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024423808 00000100:00100000:3.0:1787365069.568270:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787365069.568277:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:6864:x1874188024423808:12345-0@lo:502: 00000100:00100000:3.0:1787365069.568473:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:6864:x1874188024423808:12345-0@lo:502: Request processed in 195us (421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365069.568480:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787365069.568576:0:6864:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31ce00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:6864:1874188024423808:0@lo:502: 00000040:00080000:2.0:1787365069.568596:0:6864:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 30 count 30 00000020:01000000:1.0:1787365069.570229:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 21-29 (rc=0) 10000000:01000000:1.0:1787365069.570256:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787365069.570267:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f278f70ae00/0x872d29295eb46af7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46afe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365069.570279:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f278f70ae00/0x872d29295eb46af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46afe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365069.570303:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787365069.570306:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f2797a7c800 from 4 10000000:01000000:1.0:1787365069.570308:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787365069.570341:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87400/0x872d29295eb46b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365069.570349:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87400/0x872d29295eb46b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365069.570359:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87400/0x872d29295eb46b05 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365069.570387:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787321c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024423936:0@lo:101: 00000100:00100000:1.0:1787365069.570440:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365069.570479:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878a5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787365069.570595:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024423936 00000100:00100000:3.0:1787365069.570602:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024423936 00000100:00100000:3.0:1787365069.570676:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787365069.570684:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:5832:x1874188024423936:12345-0@lo:101: 00010000:00010000:3.0:1787365069.570696:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365069.570710:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f278f70bc00/0x872d29295eb46b0c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46b05 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365069.570740:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f278f70bc00/0x872d29295eb46b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46b05 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365069.570751:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f278f70bc00/0x872d29295eb46b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46b05 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365069.570759:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f278f70bc00, rc 0) 00000100:00100000:3.0:1787365069.570799:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:5832:x1874188024423936:12345-0@lo:101: Request processed in 116us (358us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365069.570805:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787365069.571467:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787321c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024423936:0@lo:101: 00010000:00010000:1.0:1787365069.571482:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87400/0x872d29295eb46b05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46b0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365069.571491:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87400/0x872d29295eb46b05 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46b0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365069.571548:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787321c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024424064:0@lo:256: 00000100:00100000:1.0:1787365069.571583:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365069.571612:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878a5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787365069.571831:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024424064 00000100:00100000:0.0:1787365069.571837:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024424064 00000100:00100000:0.0:1787365069.571874:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:0.0:1787365069.571882:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:5832:x1874188024424064:12345-0@lo:256: 20000000:01000000:0.0:1787365069.571897:0:5829:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:0.0:1787365069.571912:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:0.0:1787365069.571915:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 4 00000100:00100000:0.0:1787365069.571997:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:5832:x1874188024424064:12345-0@lo:256: Request processed in 116us (413us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365069.572012:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787365069.572127:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787321c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024424064:0@lo:256: 10000000:01000000:1.0:1787365069.572276:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787365069.572290:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87400/0x872d29295eb46b05 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46b0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365069.572297:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87400/0x872d29295eb46b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46b0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365069.572304:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787365069.572307:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 16 10000000:01000000:1.0:1787365069.572309:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787365069.572330:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86800/0x872d29295eb46b13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365069.572337:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86800/0x872d29295eb46b13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365069.572346:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86800/0x872d29295eb46b13 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365069.572358:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787321c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024424192:0@lo:101: 00000100:00100000:1.0:1787365069.572395:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365069.572421:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878a5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787365069.572467:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024424192 00000100:00100000:0.0:1787365069.572471:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024424192 00000100:00100000:0.0:1787365069.572500:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787365069.572506:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:5832:x1874188024424192:12345-0@lo:101: 00010000:00010000:0.0:1787365069.572515:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365069.572525:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2780031400/0x872d29295eb46b1a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46b13 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365069.572541:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2780031400/0x872d29295eb46b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46b13 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365069.572550:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2780031400/0x872d29295eb46b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46b13 expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365069.572558:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780031400, rc 0) 00000100:00100000:0.0:1787365069.572592:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:5832:x1874188024424192:12345-0@lo:101: Request processed in 86us (197us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365069.572598:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:1.0:1787365069.572911:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787321c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024424192:0@lo:101: 00010000:00010000:1.0:1787365069.572922:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86800/0x872d29295eb46b13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46b1a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365069.572930:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86800/0x872d29295eb46b13 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46b1a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365069.572975:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787321c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024424320:0@lo:501: 00000100:00100000:1.0:1787365069.573010:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365069.573037:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878a5b40 going to sleep for 11 seconds 00000100:00100000:3.0:1787365069.573085:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024424320 00000100:00100000:3.0:1787365069.573105:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024424320 00000100:00100000:3.0:1787365069.573128:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787365069.573133:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:5832:x1874188024424320:12345-0@lo:501: 00000100:00100000:3.0:1787365069.573394:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:5832:x1874188024424320:12345-0@lo:501: Request processed in 259us (383us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365069.573402:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:1.0:1787365069.573581:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787321c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024424320:0@lo:501: 00000100:00100000:1.0:1787365069.573610:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787321c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024424448:0@lo:503: 00000100:00100000:1.0:1787365069.573676:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365069.573697:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878a5b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787365069.573755:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024424448 00000100:00100000:0.0:1787365069.573760:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024424448 00000100:00100000:0.0:1787365069.573790:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787365069.573797:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:5832:x1874188024424448:12345-0@lo:503: 00000100:00100000:0.0:1787365069.574077:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:5832:x1874188024424448:12345-0@lo:503: Request processed in 279us (399us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365069.574084:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787365069.574350:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787321c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024424448:0@lo:503: 00000100:00100000:3.0:1787365069.575004:0:6865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:6865:1874188024424576:0@lo:502: 00000100:00100000:3.0:1787365069.575042:0:6865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365069.575071:0:6865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473fe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787365069.575128:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024424576 00000100:00100000:0.0:1787365069.575132:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024424576 00000100:00100000:0.0:1787365069.575176:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:0.0:1787365069.575183:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:6865:x1874188024424576:12345-0@lo:502: 00000100:00100000:0.0:1787365069.575408:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:6865:x1874188024424576:12345-0@lo:502: Request processed in 225us (365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365069.575416:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787365069.575655:0:6865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:6865:1874188024424576:0@lo:502: 00000020:01000000:2.0:1787365069.575678:0:6865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787365069.575684:0:6865:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787365069.575691:0:6865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365069.575693:0:6865:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:2.0:1787365069.575698:0:6865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787365069.575701:0:6865:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:2.0:1787365069.575731:0:6865:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787365069.575734:0:6865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787365069.575756:0:6865:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9f27bafb4d28) 00000020:00000080:2.0:1787365069.575775:0:6865:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type osp with refcount 2 00000020:00000080:2.0:1787365069.575781:0:6865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787365069.575850:0:6865:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:2.0:1787365069.575855:0:6865:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:2.0:1787365069.575868:0:6865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x872d29295eb46b28 00010000:00080000:2.0:1787365069.575894:0:6865:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f278835d800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1787365069.576149:0:6865:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-3 is initialized 00000040:01000000:2.0:1787365069.644123:0:6865:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=0, read=32 00000040:01000000:2.0:1787365069.644147:0:6865:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787365069.644740:0:6865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787365069.645046:0:6865:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787365069.645098:0:6865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].1, 64 off8256 00000040:00080000:2.0:1787365069.645171:0:6865:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].1, 64 off8256 00000040:00080000:3.0:1787365069.646569:0:6866:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787365069.646575:0:6866:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x3:0x0] at index 1 of catalog [0x1:0x2:0x0] 00000020:00000080:3.0:1787365069.647471:0:6865:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:3.0:1787365069.647484:0:6865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:3.0:1787365069.647518:0:6865:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:3.0:1787365069.647540:0:6865:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x872d29295eb46b2f 00000100:00080000:3.0:1787365069.647550:0:6865:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:3.0:1787365069.647556:0:6865:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f278835d800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1787365069.647590:0:6865:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f27bb2f3b80 x1874188024424704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787365069.647666:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024424704:0@lo:8: 00000100:00100000:0.0:1787365069.647836:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365069.647941:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024424704 00000100:00100000:1.0:1787365069.647949:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024424704 00000100:00100000:1.0:1787365069.647978:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787365069.647985:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1874188024424704:12345-0@lo:8: 00010000:00080000:1.0:1787365069.648006:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 186 last 0 00000020:00000080:1.0:1787365069.648027:0:6680:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x872d29295eb46b36 00002000:00100000:1.0:1787365069.648052:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9f27bf098000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392e ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:1.0:1787365069.648056:0:6680:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00000001:00000004:1.0:1787365069.648059:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:1.0:1787365069.648185:0:6680:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:1.0:1787365069.648322:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787365069.648344:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9f27bf09a000 : changing import state from RECOVER to FULL 00000100:00080000:3.0:1787365069.648589:0:6865:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:3.0:1787365069.648674:0:6865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787365069.648679:0:6865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365069.648680:0:6865:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:3.0:1787365069.648683:0:6865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787365069.648686:0:6865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365069.648687:0:6865:0:(obd_config.c:1563:class_process_config()) marker 14 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787365069.648690:0:6865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787365069.648692:0:6865:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:3.0:1787365069.648715:0:6865:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:6865:1874188024424832:0@lo:502: 00000100:00100000:3.0:1787365069.648781:0:6865:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365069.648808:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024424832 00000100:00100000:3.0:1787365069.648812:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024424832 00000100:00100000:3.0:1787365069.648840:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787365069.648847:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:6865:x1874188024424832:12345-0@lo:502: 00000100:00100000:3.0:1787365069.649030:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:6865:x1874188024424832:12345-0@lo:502: Request processed in 183us (247us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365069.649038:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787365069.649077:0:6865:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473f000 going to sleep for 11 seconds 00000100:00100000:3.0:1787365069.649107:0:6865:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f1500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:6865:1874188024424832:0@lo:502: 00000020:01000000:3.0:1787365069.649132:0:6865:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787365069.649136:0:6865:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365069.649138:0:6865:0:(obd_config.c:1563:class_process_config()) marker 14 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787365069.649142:0:6865:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 25 count 25 00000020:01000000:2.0:1787365069.649495:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 16-24 (rc=0) 10000000:01000000:2.0:1787365069.649515:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787365069.649526:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86800/0x872d29295eb46b13 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46b1a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365069.649535:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86800/0x872d29295eb46b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46b1a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365069.649556:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787365069.649559:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f27872bb370 from 1 10000000:01000000:2.0:1787365069.649561:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787365069.649583:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cce00/0x872d29295eb46b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365069.649591:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27a12cce00/0x872d29295eb46b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365069.649600:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27a12cce00/0x872d29295eb46b3d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365069.649613:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024425216:0@lo:101: 00000100:00100000:2.0:1787365069.649665:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365069.649689:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6af73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787365069.649705:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874188024425088:0@lo:400: 00000100:00100000:2.0:1787365069.649747:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365069.649768:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787365069.649773:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874188024424960:0@lo:400: 00000100:00100000:2.0:1787365069.649799:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365069.649826:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024425216 00000100:00100000:2.0:1787365069.649830:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024425216 00000100:00100000:2.0:1787365069.649857:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787365069.649864:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:5832:x1874188024425216:12345-0@lo:101: 00010000:00010000:2.0:1787365069.649874:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365069.649886:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46b44 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46b3d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365069.649918:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46b3d expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365069.649929:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46b3d expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365069.649937:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12ccc00, rc 0) 00000100:00100000:2.0:1787365069.649968:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:5832:x1874188024425216:12345-0@lo:101: Request processed in 104us (302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365069.649974:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:2.0:1787365069.650002:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024425088 00000100:00100000:2.0:1787365069.650006:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024425088 00000100:00100000:2.0:1787365069.650038:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024424960 00000100:00100000:2.0:1787365069.650040:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024424960 00000100:00100000:2.0:1787365069.650061:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787365069.650067:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874188024425088:12345-0@lo:400: 00000100:00100000:2.0:1787365069.650118:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874188024425088:12345-0@lo:400: Request processed in 51us (370us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365069.650125:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787365069.650138:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787365069.650144:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874188024424960:12345-0@lo:400: 00000100:00100000:2.0:1787365069.650335:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874188024424960:12345-0@lo:400: Request processed in 191us (533us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365069.650341:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:2.0:1787365069.650364:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787365069.650402:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bb31ce00 x1874188024424960/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365069.650426:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874188024424960:0@lo:400: 00010000:00080000:2.0:1787365069.650439:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bb31f100 x1874188024425088/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365085 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365069.650446:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874188024425088:0@lo:400: 00000100:00100000:2.0:1787365069.650475:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024425216:0@lo:101: 00010000:00010000:2.0:1787365069.650488:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27a12cce00/0x872d29295eb46b3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46b44 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365069.650498:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cce00/0x872d29295eb46b3d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46b44 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365069.650541:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024425344:0@lo:501: 00000100:00100000:2.0:1787365069.650565:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365069.650580:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6af73c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787365069.650592:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024425344 00000100:00100000:2.0:1787365069.650595:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024425344 00000100:00100000:2.0:1787365069.650615:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787365069.650621:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:5832:x1874188024425344:12345-0@lo:501: 00000100:00100000:2.0:1787365069.650898:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:5832:x1874188024425344:12345-0@lo:501: Request processed in 275us (331us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787365069.650906:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787365069.650939:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31df80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024425344:0@lo:501: 10000000:01000000:2.0:1787365069.650958:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:2.0:1787365069.650964:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cce00/0x872d29295eb46b3d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46b44 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365069.650978:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27a12cce00/0x872d29295eb46b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46b44 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365069.651524:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1874188024424704:12345-0@lo:8: Request processed in 3536us (3687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365069.651533:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787365069.651590:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bb2f3b80 x1874188024424704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787365079 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365069.651599:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787365069.651606:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787365069.651612:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787365069.651617:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:0.0:1787365069.651620:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9f278835d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787365069.651856:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787365069.651863:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024424704:0@lo:8: 00000004:00080000:3.0:1787365069.651924:0:6866:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787365069.652031:0:6866:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 186816405325ns, next at 0ns, rc = 0 00000004:00080000:3.0:1787365069.705446:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00000004:00080000:1.0:1787365069.740138:0:6867:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x100000000:0x1:0x0] 00000100:00100000:2.0:1787365069.740258:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024425472:0@lo:13: 00000100:00100000:2.0:1787365069.740328:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365069.740467:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024425472 00000100:00100000:0.0:1787365069.740474:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024425472 00000100:00100000:0.0:1787365069.740530:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787365069.740540:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874188024425472:12345-0@lo:13: 00002000:00000024:0.0:1787365069.740570:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:0.0:1787365069.740615:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874188024425472:12345-0@lo:13: Request processed in 77us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365069.740622:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00080000:2.0:1787365069.740700:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787365069.740734:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f2787320380 x1874188024425472/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365085 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365069.740751:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024425472:0@lo:13: 00000100:00100000:1.0:1787365069.740869:0:6867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787323100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6867:1874188024425600:0@lo:7: 00000100:00100000:1.0:1787365069.740901:0:6867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365069.740923:0:6867:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878a5e40 going to sleep for 11 seconds 00000100:00100000:2.0:1787365069.740996:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024425600 00000100:00100000:2.0:1787365069.741001:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024425600 00000100:00100000:2.0:1787365069.741034:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787365069.741041:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6867:x1874188024425600:12345-0@lo:7: 00002000:00080000:2.0:1787365069.748761:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x0 00002000:00080000:2.0:1787365069.748768:0:6682:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0000: LAST FID is [0x100000000:0x0:0x0] 00000100:00100000:2.0:1787365069.748867:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787323480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6867:x1874188024425600:12345-0@lo:7: Request processed in 7821us (7960us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365069.748877:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787365069.749078:0:6867:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f2787323100 x1874188024425600/t0(0) o7->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787365085 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365069.749108:0:6867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787323100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6867:1874188024425600:0@lo:7: 00000004:00080000:1.0:1787365069.749121:0:6867:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0000-osc-MDT0000: Got last_fid [0x100000000:0x0:0x0] 00000100:00100000:1.0:1787365069.749153:0:6867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787323100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6867:1874188024425728:0@lo:5: 00000100:00100000:1.0:1787365069.749324:0:6867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365069.749398:0:6867:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878a5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787365069.749468:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024425728 00000100:00100000:3.0:1787365069.749475:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024425728 00000100:00100000:3.0:1787365069.749515:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787365069.749524:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:6867:x1874188024425728:12345-0@lo:5: 00002000:00080000:3.0:1787365069.749547:0:6680:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:3.0:1787365069.749551:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 1 objects in group 0x0 at 1 00000100:00100000:3.0:1787365069.749809:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787321880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:6867:x1874188024425728:12345-0@lo:5: Request processed in 286us (484us total) trans 4294967297 rc 0/0 00000100:00100000:3.0:1787365069.749816:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:1.0:1787365069.752108:0:6867:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f2787323100 x1874188024425728/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787365085 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365069.752127:0:6867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787323100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6867:1874188024425728:0@lo:5: 00000004:00080000:1.0:1787365069.752141:0:6867:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x100000000:0x1:0x0] from OST, last_created [0x100000000:0x1:0x0]last_used is [0x100000000:0x1:0x0] 00000100:00100000:1.0:1787365069.752279:0:6867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787321180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6867:1874188024425856:0@lo:700: 00000100:00100000:1.0:1787365069.752327:0:6867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365069.752368:0:6867:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878a5e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787365069.752442:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024425856 00000100:00100000:3.0:1787365069.752448:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024425856 00000100:00100000:3.0:1787365069.752501:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787365069.752509:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:6867:x1874188024425856:12345-0@lo:700: 00000100:00100000:3.0:1787365069.752538:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6690:1874188024425984:0@lo:700: 00000100:00100000:3.0:1787365069.752563:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365069.752654:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473f540 going to sleep for 11 seconds 00000100:00100000:0.0:1787365069.752708:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024425984 00000100:00100000:0.0:1787365069.752712:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024425984 00000100:00100000:0.0:1787365069.752744:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787365069.752755:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6690:x1874188024425984:12345-0@lo:700: 40000000:02000000:2.0:1787365069.860617:0:5840:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000240000400-0x0000000280000400]:0:ost 00000100:00100000:2.0:1787365069.872742:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0000_UUID+5:6690:x1874188024425984:12345-0@lo:700: Request processed in 119980us (120170us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365069.872763:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:3.0:1787365069.872973:0:6690:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bb2f1500 x1874188024425984/t0(0) o700->lustre-MDT0000-lwp-OST0000@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787365085 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365069.872988:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f1500 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0000_UUID:6690:1874188024425984:0@lo:700: 40000000:02000000:3.0:1787365069.873000:0:6690:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0000-super: Allocated super-sequence [0x0000000240000400-0x0000000280000400]:0:ost] 00000001:00100000:1.0:1787365070.035970:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:1.0:1787365070.035996:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967297 is committed 00000100:00100000:0.0:1787365070.036258:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787320e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:6867:x1874188024425856:12345-0@lo:700: Request processed in 283745us (283926us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365070.036273:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:1.0:1787365070.036648:0:6867:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f2787321180 x1874188024425856/t0(0) o700->lustre-OST0000-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787365085 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365070.036659:0:6867:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:1.0:1787365070.036674:0:6867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787321180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6867:1874188024425856:0@lo:700: 00000004:02000040:1.0:1787365070.124403:0:6867:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0000-osc-MDT0000: update sequence from 0x100000000 to 0x240000400 00000100:00100000:1.0:1787365070.128966:0:6867:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787321180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6867:1874188024426112:0@lo:5: 00000100:00100000:1.0:1787365070.129027:0:6867:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365070.129176:0:6867:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878a5480 going to sleep for 11 seconds 00000100:00100000:2.0:1787365070.129216:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024426112 00000100:00100000:2.0:1787365070.129223:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024426112 00000100:00100000:2.0:1787365070.129310:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787365070.129319:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:6867:x1874188024426112:12345-0@lo:5: 00002000:00080000:2.0:1787365070.137448:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787365070.137468:0:6682:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 2 00000100:00100000:3.0:1787365070.149454:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787323100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:6867:x1874188024426112:12345-0@lo:5: Request processed in 20128us (20418us total) trans 4294967298 rc 0/0 00000100:00100000:3.0:1787365070.149468:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:1.0:1787365070.149488:0:6867:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f2787321180 x1874188024426112/t0(0) o5->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787365086 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365070.149518:0:6867:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787321180 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:6867:1874188024426112:0@lo:5: 00000004:00080000:1.0:1787365070.149532:0:6867:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x1:0x0]-[0x240000400:0x21:0x0] 00010000:00010000:3.0:1787365070.194925:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365071.228022:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365072.242861:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365073.273261:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787365073.916999:0:7050:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:1.0:1787365074.293469:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365074.802845:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024426624:0@lo:400: 00000100:00100000:2.0:1787365074.802928:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365074.803023:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787365074.803031:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024426240:0@lo:400: 00000100:00100000:2.0:1787365074.803062:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365074.803094:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024426368:0@lo:400: 00000100:00100000:2.0:1787365074.803123:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365074.803143:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787365074.803149:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024426496:0@lo:400: 00000100:00100000:2.0:1787365074.803172:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365074.803205:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024426624 00000100:00100000:2.0:1787365074.803212:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024426624 00000100:00100000:2.0:1787365074.803278:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787365074.803287:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1874188024426624:12345-0@lo:400: 00000100:00100000:2.0:1787365074.803338:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3310:x1874188024426624:12345-0@lo:400: Request processed in 52us (410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365074.803355:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787365074.803379:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024426240 00000100:00100000:2.0:1787365074.803382:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024426240 00000100:00100000:2.0:1787365074.803406:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787365074.803412:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:3310:x1874188024426240:12345-0@lo:400: 00000100:00100000:2.0:1787365074.803443:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:3310:x1874188024426240:12345-0@lo:400: Request processed in 31us (380us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365074.803449:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787365074.803490:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024426368 00000100:00100000:2.0:1787365074.803494:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024426368 00000100:00100000:2.0:1787365074.803517:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024426496 00000100:00100000:2.0:1787365074.803520:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024426496 00000100:00100000:2.0:1787365074.803540:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787365074.803546:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024426368:12345-0@lo:400: 00000100:00100000:2.0:1787365074.803581:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024426368:12345-0@lo:400: Request processed in 35us (457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365074.803587:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787365074.803599:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787365074.803605:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024426496:12345-0@lo:400: 00000100:00100000:2.0:1787365074.803654:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024426496:12345-0@lo:400: Request processed in 50us (481us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365074.803660:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787365074.803677:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787365074.803681:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787365074.803718:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bb31f800 x1874188024426496/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365074.803730:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024426496:0@lo:400: 00010000:00080000:2.0:1787365074.803740:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bb31ce00 x1874188024426368/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365074.803747:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024426368:0@lo:400: 00000100:00100000:2.0:1787365074.803772:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024426240:0@lo:400: 00010000:00080000:2.0:1787365074.803781:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bb31e300 x1874188024426624/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365090 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365074.803789:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024426624:0@lo:400: 00000100:00100000:3.0:1787365074.804203:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787320a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024426752:0@lo:13: 00000100:00100000:3.0:1787365074.804246:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365074.804330:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024426752 00000100:00100000:1.0:1787365074.804335:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024426752 00000100:00100000:1.0:1787365074.804380:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787365074.804387:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874188024426752:12345-0@lo:13: 00002000:00000024:1.0:1787365074.804416:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365074.804460:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874188024426752:12345-0@lo:13: Request processed in 75us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365074.804466:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787365074.804492:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f2787320a80 x1874188024426752/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365090 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365074.804506:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787320a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024426752:0@lo:13: 00010000:00010000:1.0:1787365075.314919:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787365075.423225:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967298 is committed 00010000:00010000:1.0:1787365076.339270:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365077.371229:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365078.391306:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365079.417849:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365079.926790:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024426880:0@lo:400: 00000100:00100000:2.0:1787365079.926866:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365079.927013:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787365079.927020:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024427008:0@lo:400: 00000100:00100000:2.0:1787365079.927061:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365079.927095:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024427136:0@lo:400: 00000100:00100000:2.0:1787365079.927118:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365079.927136:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787365079.927141:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024427264:0@lo:400: 00000100:00100000:2.0:1787365079.927164:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365079.927196:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024426880 00000100:00100000:2.0:1787365079.927202:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024426880 00000100:00100000:2.0:1787365079.927246:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787365079.927255:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:3312:x1874188024426880:12345-0@lo:400: 00000100:00100000:2.0:1787365079.927302:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:3312:x1874188024426880:12345-0@lo:400: Request processed in 48us (436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365079.927319:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787365079.927352:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024427008 00000100:00100000:2.0:1787365079.927356:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024427008 00000100:00100000:2.0:1787365079.927378:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024427136 00000100:00100000:2.0:1787365079.927381:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024427136 00000100:00100000:2.0:1787365079.927406:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787365079.927412:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024427008:12345-0@lo:400: 00000100:00100000:2.0:1787365079.927443:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024427008:12345-0@lo:400: Request processed in 31us (382us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365079.927449:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787365079.927460:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787365079.927479:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024427136:12345-0@lo:400: 00000100:00100000:2.0:1787365079.927509:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024427136:12345-0@lo:400: Request processed in 32us (390us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365079.927515:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787365079.927535:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024427264 00000100:00100000:2.0:1787365079.927538:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024427264 00000100:00100000:2.0:1787365079.927561:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787365079.927567:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024427264:12345-0@lo:400: 00000100:00100000:2.0:1787365079.927594:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024427264:12345-0@lo:400: Request processed in 27us (429us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365079.927599:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00080000:2.0:1787365079.927650:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787365079.927655:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787365079.927684:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bb31f100 x1874188024427008/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365079.927697:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024427008:0@lo:400: 00000100:00100000:2.0:1787365079.927706:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024426880:0@lo:400: 00010000:00080000:2.0:1787365079.927732:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bb31f800 x1874188024427264/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365079.927739:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787365079.927749:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31f800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024427264:0@lo:400: 00010000:00080000:2.0:1787365079.927758:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bb31ce00 x1874188024427136/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365095 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365079.927766:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024427136:0@lo:400: 00000100:00100000:2.0:1787365079.931442:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787365079.931476:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024427392:0@lo:13: 00000100:00100000:2.0:1787365079.931542:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365079.931590:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024427392 00000100:00100000:2.0:1787365079.931597:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024427392 00000100:00100000:2.0:1787365079.931658:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787365079.931667:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024427392:12345-0@lo:13: 00002000:00000024:2.0:1787365079.931697:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365079.931741:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024427392:12345-0@lo:13: Request processed in 74us (198us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365079.931748:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787365079.931787:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bb31ce00 x1874188024427392/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365095 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365079.931806:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024427392:0@lo:13: 00010000:00010000:0.0:1787365080.436961:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365081.459282:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365082.482785:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365083.506866:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365084.531096:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365085.043544:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024427776:0@lo:400: 00000100:00100000:1.0:1787365085.043610:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365085.043692:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787365085.043698:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787320a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024427648:0@lo:400: 00000100:00100000:1.0:1787365085.043726:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365085.043761:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024427776 00000100:00100000:1.0:1787365085.043768:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024427776 00000100:00100000:1.0:1787365085.043811:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787365085.043820:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024427776:12345-0@lo:400: 00000100:00100000:3.0:1787365085.044957:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024427520:0@lo:13: 00000100:00100000:3.0:1787365085.045003:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365085.045031:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024428032:0@lo:400: 00000100:00100000:3.0:1787365085.045055:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365085.045076:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787365085.045083:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874188024427904:0@lo:400: 00000100:00100000:3.0:1787365085.045108:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365085.045136:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787321500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024427776:12345-0@lo:400: Request processed in 49us (259us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365085.045148:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787365085.045149:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024427520 00000100:00100000:3.0:1787365085.045156:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024427520 00000100:00100000:1.0:1787365085.045169:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024427904 00000100:00100000:1.0:1787365085.045185:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024427904 00000100:00100000:3.0:1787365085.045208:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787365085.045221:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787365085.045222:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024427520:12345-0@lo:13: 00000100:00100000:1.0:1787365085.045230:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874188024427904:12345-0@lo:400: 00002000:00000024:3.0:1787365085.045269:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365085.045290:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874188024427904:12345-0@lo:400: Request processed in 61us (180us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365085.045297:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787365085.045318:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024427648 00000100:00100000:3.0:1787365085.045321:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024427520:12345-0@lo:13: Request processed in 103us (315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365085.045323:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024427648 00000100:00100000:3.0:1787365085.045331:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787365085.045365:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787365085.045372:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:3311:x1874188024427648:12345-0@lo:400: 00000100:00100000:1.0:1787365085.045406:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:3311:x1874188024427648:12345-0@lo:400: Request processed in 35us (1679us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365085.045413:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787365085.045427:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024428032 00000100:00100000:3.0:1787365085.045432:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024428032 00000100:00100000:3.0:1787365085.045465:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787365085.045473:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024428032:12345-0@lo:400: 00000100:00100000:3.0:1787365085.045505:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024428032:12345-0@lo:400: Request processed in 34us (450us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365085.045511:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:3.0:1787365085.045531:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787365085.045535:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787365085.045660:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787320a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024427648:0@lo:400: 00010000:00080000:0.0:1787365085.045677:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f2787321180 x1874188024427776/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365085.045689:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024427776:0@lo:400: 00010000:00080000:1.0:1787365085.047370:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f2787320380 x1874188024427904/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365085.047393:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874188024427904:0@lo:400: 00010000:00080000:1.0:1787365085.047502:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bb31ce00 x1874188024427520/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365101 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365085.047519:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024427520:0@lo:13: 00010000:00080000:1.0:1787365085.047533:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f2787321c00 x1874188024428032/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365101 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365085.047542:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024428032:0@lo:400: 00010000:00010000:0.0:1787365085.555810:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787365085.980886:0:7607:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787365085.980891:0:7607:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:3.0:1787365085.981127:0:7607:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f27882fe000 00000020:01000004:3.0:1787365085.981149:0:7607:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200062, mountfl=0 00000020:01000004:3.0:1787365085.981166:0:7607:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:3.0:1787365085.981194:0:7607:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9f27b6edcd28) 00000020:00000080:3.0:1787365085.981216:0:7607:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type osd-zfs with refcount 2 00100000:10000000:3.0:1787365085.997413:0:7607:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:3.0:1787365085.997783:0:7607:0:(scrub.c:230:scrub_file_store()) lustre-OST0001: store scrub file: rc = 0 00100000:10000000:2.0:1787365086.036972:0:7607:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x1017:0x0] => 0 (CONFIGS): rc = 1 00100000:10000000:2.0:1787365086.047752:0:7607:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787365086.048146:0:7607:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000001:0x3:0x0] => 0 (fld): rc = 1 00100000:10000000:2.0:1787365086.048212:0:7607:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787365086.048242:0:7607:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00000020:00000080:3.0:1787365086.051427:0:7607:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787365086.051450:0:7607:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787365086.051468:0:7607:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x872d29295eb46b52 00000020:01000004:3.0:1787365086.051481:0:7607:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787365086.051513:0:7607:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787365086.051517:0:7607:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787365086.051524:0:7607:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787365086.051556:0:7607:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787365086.051578:0:7607:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:2.0:1787365086.095691:0:7607:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:2.0:1787365086.095741:0:7607:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.113@tcp, index=0001, flags=0x20062 00000020:01000004:2.0:1787365086.095746:0:7607:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:2.0:1787365086.095748:0:7607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787365086.095750:0:7607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787365086.095751:0:7607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787365086.095753:0:7607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787365086.095754:0:7607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787365086.095756:0:7607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787365086.095758:0:7607:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787365086.095763:0:7607:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787365086.099130:0:7607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787365086.099138:0:7607:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787365086.099145:0:7607:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020062 00000020:01000004:2.0:1787365086.099150:0:7607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787365086.099152:0:7607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:2.0:1787365086.099154:0:7607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787365086.099155:0:7607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787365086.099156:0:7607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787365086.099157:0:7607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787365086.099159:0:7607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:2.0:1787365086.099160:0:7607:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:2.0:1787365086.099162:0:7607:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:2.0:1787365086.099163:0:7607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787365086.099164:0:7607:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:2.0:1787365086.099211:0:7607:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:2.0:1787365086.099238:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024428160:0@lo:253: 00000100:00100000:2.0:1787365086.099378:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365086.099526:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b66d9480 going to sleep for 11 seconds 00000100:00100000:0.0:1787365086.103317:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024428160 00000100:00100000:0.0:1787365086.103340:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024428160 00000100:00100000:0.0:1787365086.103414:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787365086.103426:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:7607:x1874188024428160:12345-0@lo:253: 20000000:01000000:0.0:1787365086.103473:0:5828:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787365086.103478:0:5828:0:(mgs_handler.c:599:mgs_target_reg()) updating lustre-OST0001, index=1 20000000:01000000:0.0:1787365086.103484:0:5828:0:(mgs_llog.c:869:mgs_set_index()) Set index for lustre-OST0001 to 1 20000000:01000000:0.0:1787365086.103488:0:5828:0:(mgs_llog.c:3862:mgs_write_log_ost()) writing new ost lustre-OST0001 00000040:00080000:0.0:1787365086.106590:0:5828:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787365086.107392:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 20000000:01000000:1.0:1787365086.107419:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf001 obdfilter lustre-OST0001_UUID (null) (null) 00000040:00080000:1.0:1787365086.107473:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 128 off8544 20000000:01000000:1.0:1787365086.107483:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001 0xcf003 dev type f (null) 00000040:00080000:1.0:1787365086.107514:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 112 off8656 00000040:00080000:1.0:1787365086.107583:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8880 00000040:00080000:1.0:1787365086.108093:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 224 off12648 20000000:01000000:1.0:1787365086.108117:0:5828:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:1.0:1787365086.108120:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:1.0:1787365086.108153:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 88 off12736 20000000:01000000:1.0:1787365086.108161:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf001 osc lustre-MDT0000-mdtlov_UUID (null) (null) 00000040:00080000:1.0:1787365086.108205:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 144 off12880 20000000:01000000:1.0:1787365086.108213:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc-MDT0000 0xcf003 lustre-OST0001_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:1.0:1787365086.108244:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 152 off13032 20000000:01000000:1.0:1787365086.108254:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-MDT0000-mdtlov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787365086.108298:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 136 off13168 00000040:00080000:1.0:1787365086.108349:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13392 00000040:00080000:1.0:1787365086.109128:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].30, 224 off13416 20000000:01000000:1.0:1787365086.109149:0:5828:0:(mgs_llog.c:3815:mgs_write_log_osc_to_lov()) add nid 192.168.203.113@tcp 20000000:01000000:1.0:1787365086.109158:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg (null) 0xcf005 192.168.203.113@tcp (null) (null) (null) 00000040:00080000:1.0:1787365086.109195:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].31, 88 off13504 20000000:01000000:1.0:1787365086.109203:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf001 osc lustre-clilov_UUID (null) (null) 00000040:00080000:1.0:1787365086.109234:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].32, 128 off13632 20000000:01000000:1.0:1787365086.109241:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-OST0001-osc 0xcf003 lustre-OST0001_UUID 192.168.203.113@tcp (null) (null) 00000040:00080000:1.0:1787365086.109280:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].33, 144 off13776 20000000:01000000:1.0:1787365086.109287:0:5828:0:(mgs_llog.c:1539:record_base_raw()) lcfg lustre-clilov 0xcf00d lustre-OST0001_UUID 1 1 (null) 00000040:00080000:1.0:1787365086.109332:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].34, 128 off13904 00000040:00080000:1.0:1787365086.109370:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].35, 224 off14128 20000000:01000000:1.0:1787365086.109386:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' autodegrade=on ', param: 'sys.timeout=20' 20000000:01000000:1.0:1787365086.109389:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.timeout=20' 20000000:01000000:1.0:1787365086.109394:0:5828:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.timeout=20' val=20 20000000:01000000:1.0:1787365086.109411:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:1.0:1787365086.109414:0:5828:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:1.0:1787365086.109451:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:1.0:1787365086.109453:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.timeout fl=4 00000040:00080000:0.0:1787365086.114341:0:7609:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 5 count 5 00000040:00080000:1.0:1787365086.114956:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9104 00000040:00080000:1.0:1787365086.115000:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 80 off9184 00000040:00080000:1.0:1787365086.115076:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 224 off9408 20000000:01000000:1.0:1787365086.115088:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:1.0:1787365086.115091:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.timeout fl=4 20000000:01000000:1.0:1787365086.116125:0:7610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 22 marker 14 1->4: lustre sys.timeout 20000000:01000000:1.0:1787365086.116193:0:7610:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 24 marker 14 2->4: lustre sys.timeout 00000040:00080000:1.0:1787365086.116252:0:7610:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 31 count 31 00000040:00080000:1.0:1787365086.119714:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 224 off13616 00000040:00080000:1.0:1787365086.119782:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 80 off13696 00000040:00080000:1.0:1787365086.119870:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 224 off13920 20000000:01000000:1.0:1787365086.119887:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787365086.119890:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.timeout fl=4 20000000:01000000:0.0:1787365086.121176:0:7611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 5 marker 15 1->4: lustre sys.timeout 20000000:01000000:0.0:1787365086.121295:0:7611:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 7 marker 15 2->4: lustre sys.timeout 00000040:00080000:0.0:1787365086.121328:0:7611:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 8 count 8 00000040:00080000:1.0:1787365086.121726:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 224 off9632 00000040:00080000:1.0:1787365086.121762:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 80 off9712 00000040:00080000:1.0:1787365086.122978:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].10, 224 off9936 20000000:01000000:1.0:1787365086.123065:0:5828:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:1.0:1787365086.123077:0:5828:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.timeout fl=4 20000000:01000000:2.0:1787365086.126317:0:7612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 27 marker 16 1->4: lustre sys.timeout 20000000:01000000:2.0:1787365086.126428:0:7612:0:(mgs_llog.c:1076:mgs_modify_handler()) Changing rec 29 marker 16 2->4: lustre sys.timeout 00000040:00080000:2.0:1787365086.126479:0:7612:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 36 count 36 00000040:00080000:3.0:1787365086.127177:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].36, 224 off14352 00000040:00080000:3.0:1787365086.127226:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].37, 80 off14432 00000040:00080000:3.0:1787365086.127259:0:5828:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].38, 224 off14656 20000000:01000000:3.0:1787365086.127292:0:5828:0:(mgs_llog.c:5252:mgs_write_log_target()) remaining string: ' ', param: 'autodegrade=on' 20000000:01000000:3.0:1787365086.127295:0:5828:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'autodegrade=on' 10000000:01000000:3.0:1787365086.127307:0:5828:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:3.0:1787365086.127331:0:5828:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f278f70a400/0x872d29295eb46b59 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.127354:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f27a12cd200/0x872d29295eb46aaa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46aa3 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.127362:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f278f70a800/0x872d29295eb46ad4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46acd expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.127369:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f278f70aa00/0x872d29295eb46afe lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46af7 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.127376:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f2780031400/0x872d29295eb46b1a lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46b13 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.127383:0:5828:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46b44 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46b3d expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.127390:0:5828:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f278f70a400/0x872d29295eb46b59 lrc: 8/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.127442:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46b44 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46b3d expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.127460:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46b44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46b3d expref: 16 pid: 5827 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365086.127492:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5828:1874188024428288:0@lo:104: 00000100:00100000:3.0:1787365086.127588:0:5828:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:3.0:1787365086.127695:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f2780031400/0x872d29295eb46b1a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46b13 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.127704:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f2780031400/0x872d29295eb46b1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46b13 expref: 16 pid: 5828 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365086.127714:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5828:1874188024428416:0@lo:104: 00010000:00010000:3.0:1787365086.127738:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f278f70aa00/0x872d29295eb46afe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46af7 expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.127746:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f278f70aa00/0x872d29295eb46afe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46af7 expref: 16 pid: 5829 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365086.127754:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5828:1874188024428544:0@lo:104: 00010000:00010000:3.0:1787365086.127789:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f278f70a800/0x872d29295eb46ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46acd expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.127798:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f278f70a800/0x872d29295eb46ad4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46acd expref: 16 pid: 5829 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365086.127807:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5828:1874188024428672:0@lo:104: 00010000:00010000:3.0:1787365086.127848:0:5828:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f27a12cd200/0x872d29295eb46aaa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46aa3 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.127856:0:5828:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f27a12cd200/0x872d29295eb46aaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46aa3 expref: 16 pid: 5827 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365086.127877:0:5828:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5828:1874188024428800:0@lo:104: 00000100:00100000:3.0:1787365086.127897:0:5828:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278fd560c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787365086.128209:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:2.0:1787365086.128230:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365086.128260:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365086.128298:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365086.128312:0:5816:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365086.128324:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024428288 00000100:00100000:2.0:1787365086.128332:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024428288 00000100:00100000:2.0:1787365086.128375:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024428416 00000100:00100000:2.0:1787365086.128378:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024428416 00000100:00100000:2.0:1787365086.128388:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024428544 00000100:00100000:2.0:1787365086.128390:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024428544 00000100:00100000:2.0:1787365086.128398:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024428672 00000100:00100000:2.0:1787365086.128399:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024428672 00000100:00100000:2.0:1787365086.128407:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024428800 00000100:00100000:2.0:1787365086.128415:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024428800 00000100:00100000:2.0:1787365086.128434:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787365086.128443:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2783e2b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+7:5828:x1874188024428288:12345-0@lo:104: 00010000:00010000:2.0:1787365086.128458:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f27a12cce00/0x872d29295eb46b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46b44 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.128526:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787365086.128531:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2783e2b050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+7:5828:x1874188024428288:12345-0@lo:104: Request processed in 90us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365086.128539:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787365086.128587:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787365086.128593:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+6:5828:x1874188024428416:12345-0@lo:104: 00010000:00010000:2.0:1787365086.128601:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86800/0x872d29295eb46b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46b1a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.128650:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787365086.128655:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+6:5828:x1874188024428416:12345-0@lo:104: Request processed in 64us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365086.128661:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787365086.128673:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787365086.128679:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+5:5828:x1874188024428544:12345-0@lo:104: 00010000:00010000:2.0:1787365086.128687:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f278f70ae00/0x872d29295eb46af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46afe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.128713:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787365086.128718:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+5:5828:x1874188024428544:12345-0@lo:104: Request processed in 40us (458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365086.128723:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787365086.128743:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787365086.128749:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+4:5828:x1874188024428672:12345-0@lo:104: 00010000:00010000:2.0:1787365086.128757:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46acd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46ad4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.128879:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787365086.128889:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a12cce00/0x872d29295eb46b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46b44 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.128912:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cce00 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:0.0:1787365086.128916:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cce00/0x872d29295eb46b3d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46b44 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.128926:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a12cce00/0x872d29295eb46b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46b44 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365086.128933:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cce00/0x872d29295eb46b3d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46b44 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365086.128940:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787365086.128980:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27a12cce00/0x872d29295eb46b3d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46b44 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.128999:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787365086.129020:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cce00/0x872d29295eb46b3d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46b44 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.129029:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a12cce00/0x872d29295eb46b3d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46b44 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.129043:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787365086.129047:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86800/0x872d29295eb46b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46b1a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.129053:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a0f86800 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:0.0:1787365086.129056:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86800/0x872d29295eb46b13 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46b1a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.129074:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86800/0x872d29295eb46b13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46b1a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365086.129081:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86800/0x872d29295eb46b13 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46b1a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365086.129087:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787365086.129101:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86800/0x872d29295eb46b13 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46b1a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.129108:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787365086.129113:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86800/0x872d29295eb46b13 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46b1a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.129120:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86800/0x872d29295eb46b13 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46b1a expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.129131:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365086.129134:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f278f70ae00/0x872d29295eb46af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46afe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.129140:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f278f70ae00 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:0.0:1787365086.129143:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f278f70ae00/0x872d29295eb46af7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46afe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.129150:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f278f70ae00/0x872d29295eb46af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46afe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365086.129156:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f278f70ae00/0x872d29295eb46af7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46afe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365086.129167:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787365086.129181:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f278f70ae00/0x872d29295eb46af7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46afe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.129188:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787365086.129211:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f278f70ae00/0x872d29295eb46af7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46afe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.129230:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f278f70ae00/0x872d29295eb46af7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46afe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.129242:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365086.129244:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365086.129246:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365086.129254:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365086.129290:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024428928:0@lo:103: 00000100:00100000:0.0:1787365086.129332:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365086.129374:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787365086.129380:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024429056:0@lo:103: 00000100:00100000:0.0:1787365086.129403:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365086.129435:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024429184:0@lo:103: 00000100:00100000:0.0:1787365086.129458:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365086.129491:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024428928 00000100:00100000:0.0:1787365086.129497:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024428928 00010000:00010000:0.0:1787365086.129524:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46b44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46b3d expref: 17 pid: 5827 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365086.129543:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024429056 00000100:00100000:0.0:1787365086.129552:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024429056 00010000:00010000:0.0:1787365086.129568:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f2780031400/0x872d29295eb46b1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46b13 expref: 18 pid: 5828 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365086.129579:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024429184 00000100:00100000:0.0:1787365086.129582:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024429184 00010000:00010000:0.0:1787365086.129593:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f278f70aa00/0x872d29295eb46afe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46af7 expref: 19 pid: 5829 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365086.129606:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787365086.129613:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024428928:12345-0@lo:103: 00010000:00010000:0.0:1787365086.129662:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365086.129668:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46b44 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46b3d expref: 19 pid: 5827 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.129682:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46b44 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46b3d expref: 19 pid: 5827 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.129706:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365086.129739:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024428928:12345-0@lo:103: Request processed in 126us (406us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365086.129747:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787365086.129763:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787365086.129918:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:3310:x1874188024429056:12345-0@lo:103: 00010000:00010000:0.0:1787365086.129926:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365086.129931:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f2780031400/0x872d29295eb46b1a lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46b13 expref: 18 pid: 5828 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.129941:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f2780031400/0x872d29295eb46b1a lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46b13 expref: 18 pid: 5828 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.129963:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365086.130047:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:3310:x1874188024429056:12345-0@lo:103: Request processed in 130us (641us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365086.130053:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787365086.130068:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787365086.130075:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:3312:x1874188024429184:12345-0@lo:103: 00010000:00010000:0.0:1787365086.130082:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365086.130087:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f278f70aa00/0x872d29295eb46afe lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46af7 expref: 17 pid: 5829 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.130095:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f278f70aa00/0x872d29295eb46afe lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46af7 expref: 17 pid: 5829 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.130106:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365086.130132:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b55180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:3312:x1874188024429184:12345-0@lo:103: Request processed in 58us (674us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365086.130139:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787365086.130187:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b57100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024429184:0@lo:103: 00000100:00100000:0.0:1787365086.130213:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024429056:0@lo:103: 00000100:00100000:0.0:1787365086.130220:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024428928:0@lo:103: 00010000:00010000:2.0:1787365086.131754:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:3.0:1787365086.132050:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46b44 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46b3d expref: 16 pid: 5827 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365086.132072:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f3480 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5828:1874188024428288:0@lo:104: 00010000:00010000:3.0:1787365086.132086:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2780031400/0x872d29295eb46b1a lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46b13 expref: 15 pid: 5828 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365086.132095:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f1880 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5828:1874188024428416:0@lo:104: 00010000:00010000:3.0:1787365086.132105:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f278f70aa00/0x872d29295eb46afe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46af7 expref: 14 pid: 5829 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365086.132113:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f1180 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5828:1874188024428544:0@lo:104: 00000100:00100000:3.0:1787365086.132121:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f3b80 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5828:1874188024428672:0@lo:104: 00000100:00100000:2.0:1787365086.132304:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+4:5828:x1874188024428672:12345-0@lo:104: Request processed in 3553us (4003us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365086.132316:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00010000:00010000:0.0:1787365086.132795:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365086.132807:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46acd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46ad4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.132817:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a0f86a00 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:0.0:1787365086.132822:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46acd lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46ad4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.132851:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46acd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46ad4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365086.132858:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46acd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46ad4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365086.132864:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:0.0:1787365086.132919:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46acd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46ad4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.132926:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787365086.132945:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46acd lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46ad4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.132953:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46acd lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46ad4 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.132969:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365086.132971:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365086.132973:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365086.133099:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024429312:0@lo:103: 00000100:00100000:0.0:1787365086.133165:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365086.133244:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024429312 00000100:00100000:0.0:1787365086.133252:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024429312 00010000:00010000:0.0:1787365086.133298:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f278f70a800/0x872d29295eb46ad4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46acd expref: 14 pid: 5829 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365086.133330:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787365086.133339:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:3313:x1874188024429312:12345-0@lo:103: 00010000:00010000:0.0:1787365086.133361:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365086.133367:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f278f70a800/0x872d29295eb46ad4 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46acd expref: 14 pid: 5829 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.133379:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f278f70a800/0x872d29295eb46ad4 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46acd expref: 14 pid: 5829 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.133397:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f278f70a800/0x872d29295eb46ad4 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46acd expref: 14 pid: 5829 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365086.133413:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365086.133447:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:3313:x1874188024429312:12345-0@lo:103: Request processed in 109us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365086.133454:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787365086.133488:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b56d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024429312:0@lo:103: 00000100:00100000:3.0:1787365086.135025:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787365086.135049:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:5828:x1874188024428800:12345-0@lo:104: 00010000:00010000:3.0:1787365086.135071:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc800/0x872d29295eb46aa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46aaa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.135186:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787365086.135193:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:5828:x1874188024428800:12345-0@lo:104: Request processed in 156us (6879us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365086.135201:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00010000:00010000:3.0:1787365086.135234:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365086.135240:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc800/0x872d29295eb46aa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46aaa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.135277:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cc800 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:3.0:1787365086.135283:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc800/0x872d29295eb46aa3 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46aaa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.135294:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc800/0x872d29295eb46aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46aaa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787365086.135302:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc800/0x872d29295eb46aa3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46aaa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365086.135308:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787365086.135354:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc800/0x872d29295eb46aa3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46aaa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.135362:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787365086.135385:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc800/0x872d29295eb46aa3 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46aaa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.135393:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc800/0x872d29295eb46aa3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46aaa expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.135416:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365086.135418:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365086.135420:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365086.135428:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787365086.135444:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024429440:0@lo:103: 00000100:00100000:3.0:1787365086.135487:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365086.135542:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024429440 00000100:00100000:3.0:1787365086.135550:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024429440 00010000:00010000:3.0:1787365086.135582:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f27a12cd200/0x872d29295eb46aaa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46aa3 expref: 13 pid: 5827 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365086.135611:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787365086.135617:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:3311:x1874188024429440:12345-0@lo:103: 00010000:00010000:3.0:1787365086.135650:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365086.135656:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f27a12cd200/0x872d29295eb46aaa lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46aa3 expref: 13 pid: 5827 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.135666:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f27a12cd200/0x872d29295eb46aaa lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46aa3 expref: 13 pid: 5827 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.135687:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f278f70a400/0x872d29295eb46b59 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.135697:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f278f70a400/0x872d29295eb46b59 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.135714:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f278f70a400/0x872d29295eb46b59 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.135722:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f278f70a400/0x872d29295eb46b59 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.135729:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f278f70a400/0x872d29295eb46b59 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.135735:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f278f70a400/0x872d29295eb46b59 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.135740:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f278f70a400 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365086.135745:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f278f70a400/0x872d29295eb46b59 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.135760:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f278f70a400/0x872d29295eb46b59 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.135776:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f278f70a400/0x872d29295eb46b59 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.135787:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365086.135816:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f2680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:3311:x1874188024429440:12345-0@lo:103: Request processed in 199us (329us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365086.135822:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787365086.135865:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024429440:0@lo:103: 00010000:00010000:2.0:1787365086.136376:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a12cd200/0x872d29295eb46aaa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46aa3 expref: 12 pid: 5827 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365086.136389:0:5828:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f2300 pname:cluuid:pid:xid:nid:opc:job ll_mgs_0001:MGS:5828:1874188024428800:0@lo:104: 00010000:00010000:2.0:1787365086.136420:0:5828:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f278f70a400/0x872d29295eb46b59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.136431:0:5828:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f278f70a400/0x872d29295eb46b59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.136437:0:5828:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f278f70a400/0x872d29295eb46b59 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.136443:0:5828:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f278f70a400/0x872d29295eb46b59 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787365086.136463:0:5828:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787365086.190662:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:7607:x1874188024428160:12345-0@lo:253: Request processed in 87197us (91244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365086.190681:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:1.0:1787365086.190882:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31e300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024428160:0@lo:253: 10000000:01000000:1.0:1787365086.190902:0:7607:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:1.0:1787365086.190906:0:7607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787365086.190908:0:7607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787365086.190910:0:7607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787365086.190911:0:7607:0:(tgt_mount.c:1178:server_mti_print()) uuid: lustre-OST0001_UUID 00000020:01000004:1.0:1787365086.190913:0:7607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787365086.190914:0:7607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787365086.190915:0:7607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787365086.190917:0:7607:0:(tgt_mount.c:1196:server_mti_print()) LDD_F_REWRITE_LDD 00000020:01000004:1.0:1787365086.190919:0:7607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787365086.190920:0:7607:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787365086.190945:0:7607:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f27882fe000 from lustre-OST0001 10000000:01000000:1.0:1787365086.190974:0:7607:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:1.0:1787365086.190978:0:7607:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:1.0:1787365086.191122:0:7607:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f27872bb370 local copy 10000000:01000000:1.0:1787365086.191128:0:7607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787365086.191177:0:7607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86c00/0x872d29295eb46b60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365086.191189:0:7607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x0 ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86c00/0x872d29295eb46b60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365086.191200:0:7607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86c00/0x872d29295eb46b60 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365086.191221:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787321c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024429568:0@lo:101: 00000100:00100000:1.0:1787365086.191281:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365086.191484:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bcfb9300 going to sleep for 11 seconds 00000100:00100000:3.0:1787365086.191898:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024429568 00000100:00100000:3.0:1787365086.191907:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024429568 00000100:00100000:3.0:1787365086.192064:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787365086.192075:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+11:7607:x1874188024429568:12345-0@lo:101: 00010000:00010000:3.0:1787365086.192093:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365086.192113:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f278f70aa00/0x872d29295eb46b67 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46b60 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.192143:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f278f70aa00/0x872d29295eb46b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46b60 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.192154:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f278f70aa00/0x872d29295eb46b67 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46b60 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.192164:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f278f70aa00, rc 0) 00000100:00100000:3.0:1787365086.192261:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:7607:x1874188024429568:12345-0@lo:101: Request processed in 187us (979us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365086.192295:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787365086.192381:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787321c00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024429568:0@lo:101: 00010000:00010000:2.0:1787365086.192398:0:7607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86c00/0x872d29295eb46b60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x872d29295eb46b67 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.192419:0:7607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86c00/0x872d29295eb46b60 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x872d29295eb46b67 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365086.192551:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024429696:0@lo:501: 00000100:00100000:2.0:1787365086.192585:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365086.192698:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abfcf300 going to sleep for 11 seconds 00000100:00100000:3.0:1787365086.192759:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024429696 00000100:00100000:3.0:1787365086.192884:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024429696 00000100:00100000:3.0:1787365086.192922:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787365086.192931:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:7607:x1874188024429696:12345-0@lo:501: 00000100:00100000:3.0:1787365086.193303:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:7607:x1874188024429696:12345-0@lo:501: Request processed in 371us (715us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787365086.193311:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787365086.193402:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024429696:0@lo:501: 10000000:01000000:2.0:1787365086.193421:0:7607:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:2.0:1787365086.193453:0:7607:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:2.0:1787365086.193461:0:7607:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86c00/0x872d29295eb46b60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x872d29295eb46b67 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.193471:0:7607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86c00/0x872d29295eb46b60 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x872d29295eb46b67 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.193479:0:7607:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86c00/0x872d29295eb46b60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000400000000 nid: local remote: 0x872d29295eb46b67 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.193510:0:7607:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:2.0:1787365086.193537:0:7607:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f27882fe000 10000000:01000000:2.0:1787365086.193543:0:7607:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:2.0:1787365086.193549:0:7607:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:2.0:1787365086.193552:0:7607:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787365086.193557:0:7607:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:2.0:1787365086.193560:0:7607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787365086.193587:0:7607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46b6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.193607:0:7607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46b6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.193617:0:7607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46b6e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365086.193699:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024429824:0@lo:101: 00000100:00100000:2.0:1787365086.193734:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787365086.193867:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365086.193876:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86c00/0x872d29295eb46b60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x872d29295eb46b67 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365086.193895:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a0f86c00 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:1.0:1787365086.193900:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86c00/0x872d29295eb46b60 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x400000000 nid: local remote: 0x872d29295eb46b67 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365086.193909:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86c00/0x872d29295eb46b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x8400000000 nid: local remote: 0x872d29295eb46b67 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787365086.193917:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86c00/0x872d29295eb46b60 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x9400000000 nid: local remote: 0x872d29295eb46b67 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365086.193924:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:1.0:1787365086.193948:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86c00/0x872d29295eb46b60 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x872d29295eb46b67 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365086.193954:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787365086.193973:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86c00/0x872d29295eb46b60 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x872d29295eb46b67 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365086.193980:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86c00/0x872d29295eb46b60 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x4809400000020 nid: local remote: 0x872d29295eb46b67 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365086.194006:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365086.194010:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365086.194011:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365086.194101:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abfcfe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787365086.194167:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024429824 00000100:00100000:3.0:1787365086.194174:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024429824 00000100:00100000:3.0:1787365086.194218:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787365086.194227:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:7607:x1874188024429824:12345-0@lo:101: 00010000:00010000:3.0:1787365086.194239:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365086.194254:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f278f70b000/0x872d29295eb46b75 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46b6e expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.194289:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f278f70b000/0x872d29295eb46b75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46b6e expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.194301:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f278f70b000/0x872d29295eb46b75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46b6e expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.194310:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f278f70b000, rc 0) 00000100:00100000:3.0:1787365086.194355:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:7607:x1874188024429824:12345-0@lo:101: Request processed in 129us (618us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365086.194362:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787365086.194395:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024429952:0@lo:103: 00000100:00100000:3.0:1787365086.194438:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365086.194484:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024429952 00000100:00100000:3.0:1787365086.194488:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024429952 00000100:00100000:3.0:1787365086.194518:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787365086.194525:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:3311:x1874188024429952:12345-0@lo:103: 00010000:00010000:3.0:1787365086.194535:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365086.194550:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f278f70aa00/0x872d29295eb46b67 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x872d29295eb46b60 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.194561:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365086.194588:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:3311:x1874188024429952:12345-0@lo:103: Request processed in 63us (149us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365086.194594:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787365086.194667:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787320380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024429952:0@lo:103: 00000100:00100000:1.0:1787365086.194755:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc4380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024429824:0@lo:101: 00010000:00010000:1.0:1787365086.194781:0:7607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46b6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46b75 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365086.194791:0:7607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46b6e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46b75 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365086.194907:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024430080:0@lo:501: 00000100:00100000:1.0:1787365086.194938:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365086.194961:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bcfb9540 going to sleep for 11 seconds 00000100:00100000:3.0:1787365086.195117:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024430080 00000100:00100000:3.0:1787365086.195122:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024430080 00000100:00100000:3.0:1787365086.195143:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787365086.195150:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:7607:x1874188024430080:12345-0@lo:501: 00000100:00100000:3.0:1787365086.195429:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:7607:x1874188024430080:12345-0@lo:501: Request processed in 278us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365086.195437:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787365086.195580:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024430080:0@lo:501: 00000100:00100000:2.0:1787365086.196069:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024430208:0@lo:503: 00000100:00100000:2.0:1787365086.196131:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365086.196164:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abfcfb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787365086.196239:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024430208 00000100:00100000:3.0:1787365086.196245:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024430208 00000100:00100000:3.0:1787365086.196293:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787365086.196302:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:7607:x1874188024430208:12345-0@lo:503: 00000100:00100000:3.0:1787365086.196509:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:7607:x1874188024430208:12345-0@lo:503: Request processed in 208us (377us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365086.196526:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787365086.196660:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024430208:0@lo:503: 00000040:00080000:1.0:1787365086.197274:0:7607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787365086.197364:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024430336:0@lo:502: 00000100:00100000:1.0:1787365086.197424:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365086.197464:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bcfb9540 going to sleep for 11 seconds 00000100:00100000:3.0:1787365086.197548:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024430336 00000100:00100000:3.0:1787365086.197555:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024430336 00000100:00100000:3.0:1787365086.197601:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787365086.197611:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:7607:x1874188024430336:12345-0@lo:502: 00000100:00100000:3.0:1787365086.197978:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:7607:x1874188024430336:12345-0@lo:502: Request processed in 368us (553us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365086.198100:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024430336:0@lo:502: 00000040:00080000:1.0:1787365086.198420:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].1, 224 off8416 00000040:00080000:1.0:1787365086.198482:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].2, 128 off8544 00000040:00080000:1.0:1787365086.198520:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].3, 112 off8656 00000040:00080000:1.0:1787365086.198575:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8880 00000040:00080000:1.0:1787365086.198617:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 224 off9104 00000040:00080000:1.0:1787365086.198693:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 80 off9184 00000100:00100000:1.0:1787365086.198735:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024430464:0@lo:502: 00000100:00100000:3.0:1787365086.198885:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787365086.199225:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365086.199304:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bcfb9540 going to sleep for 11 seconds 00000100:00100000:2.0:1787365086.199347:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024430464 00000100:00100000:2.0:1787365086.199355:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024430464 00000100:00100000:2.0:1787365086.199405:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787365086.199414:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:7607:x1874188024430464:12345-0@lo:502: 00000100:00100000:2.0:1787365086.199856:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:7607:x1874188024430464:12345-0@lo:502: Request processed in 442us (630us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365086.199865:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:1.0:1787365086.200048:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024430464:0@lo:502: 00000040:00080000:0.0:1787365086.200303:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9408 00000040:00080000:0.0:1787365086.200320:0:7607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 7 count 8 00000020:01000000:3.0:1787365086.201161:0:7615:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:3.0:1787365086.201173:0:7615:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:3.0:1787365086.201181:0:7615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365086.201183:0:7615:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:3.0:1787365086.201192:0:7615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:3.0:1787365086.201212:0:7615:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9f27b6ed99b8) 00000020:00000080:3.0:1787365086.201254:0:7615:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type obdfilter with refcount 2 00000020:00000080:3.0:1787365086.201260:0:7615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:3.0:1787365086.201364:0:7615:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f27882fe000 from lustre-OST0001, refs=2 00080000:01000000:3.0:1787365086.201374:0:7615:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787365086.201383:0:7615:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x872d29295eb46b83 00010000:00010000:3.0:1787365086.206427:0:7615:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:02000400:3.0:1787365086.207113:0:7615:0:(tgt_lastrcvd.c:1878:tgt_server_data_init()) lustre-OST0001: new disk, initializing 00000001:00000004:3.0:1787365086.209842:0:7615:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 0 40000000:02000000:3.0:1787365086.210316:0:7615:0:(fid_handler.c:560:seq_server_init()) srv-lustre-OST0001: No data found on store. Initialize space. 00080000:10000000:3.0:1787365086.220179:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000001:0x3:0x0] (8/8/3) registered 00080000:10000000:3.0:1787365086.221289:0:7615:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x3:0x0] (8/8/4) registered 00000020:00000080:3.0:1787365086.226889:0:7615:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:3.0:1787365086.226905:0:7615:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787365086.226913:0:7615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365086.226915:0:7615:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:3.0:1787365086.226924:0:7615:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787365086.226928:0:7615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365086.226929:0:7615:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:3.0:1787365086.226932:0:7615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:3.0:1787365086.226934:0:7615:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:3.0:1787365086.227130:0:7615:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787365086.227135:0:7615:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365086.227136:0:7615:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000040:00080000:3.0:1787365086.227140:0:7615:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000020:01000000:2.0:1787365086.227370:0:7607:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-7 (rc=0) 10000000:01000000:2.0:1787365086.227403:0:7607:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787365086.227429:0:7607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46b6e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46b75 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.227443:0:7607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46b6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46b75 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365086.227469:0:7607:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f27882fe000 from 1 10000000:01000000:2.0:1787365086.227472:0:7607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787365086.227520:0:7607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc600/0x872d29295eb46b8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.227529:0:7607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc600/0x872d29295eb46b8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.227543:0:7607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc600/0x872d29295eb46b8a lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365086.227573:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024430592:0@lo:101: 00000100:00100000:2.0:1787365086.227702:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365086.227759:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abfcfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787365086.227833:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024430592 00000100:00100000:1.0:1787365086.227842:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024430592 00000100:00100000:1.0:1787365086.227897:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:1.0:1787365086.227908:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:7607:x1874188024430592:12345-0@lo:101: 00010000:00010000:1.0:1787365086.227934:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365086.227950:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a0f86c00/0x872d29295eb46b91 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46b8a expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365086.227979:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a0f86c00/0x872d29295eb46b91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46b8a expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365086.228002:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a0f86c00/0x872d29295eb46b91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46b8a expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365086.228012:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a0f86c00, rc 0) 00000100:00100000:1.0:1787365086.228060:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:7607:x1874188024430592:12345-0@lo:101: Request processed in 153us (357us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365086.228067:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787365086.228316:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024430592:0@lo:101: 00010000:00010000:2.0:1787365086.228333:0:7607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc600/0x872d29295eb46b8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46b91 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.228343:0:7607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc600/0x872d29295eb46b8a lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46b91 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365086.228472:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024430720:0@lo:501: 00000100:00100000:2.0:1787365086.228500:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365086.228573:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abfcfe40 going to sleep for 11 seconds 00000100:00100000:1.0:1787365086.237326:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024430720 00000100:00100000:1.0:1787365086.237346:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024430720 00000100:00100000:2.0:1787365086.238475:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787365086.238488:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:7607:x1874188024430720:12345-0@lo:501: 00000100:00100000:2.0:1787365086.238898:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:7607:x1874188024430720:12345-0@lo:501: Request processed in 412us (10396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365086.238913:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787365086.238972:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024430720:0@lo:501: 00000100:00100000:2.0:1787365086.239840:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024430848:0@lo:503: 00000100:00100000:2.0:1787365086.239908:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365086.240514:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abfcfe40 going to sleep for 11 seconds 00000100:00100000:0.0:1787365086.244888:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024430848 00000100:00100000:0.0:1787365086.244908:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024430848 00000100:00100000:2.0:1787365086.247112:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787365086.247130:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:7607:x1874188024430848:12345-0@lo:503: 00000100:00100000:2.0:1787365086.247708:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:7607:x1874188024430848:12345-0@lo:503: Request processed in 580us (7797us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365086.247717:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787365086.248080:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc7100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024430848:0@lo:503: 00000040:00080000:3.0:1787365086.248451:0:7607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787365086.248550:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024430976:0@lo:502: 00000100:00100000:3.0:1787365086.248671:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365086.248707:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278fd563c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365086.248920:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024430976 00000100:00100000:1.0:1787365086.248928:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024430976 00000100:00100000:1.0:1787365086.248993:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787365086.249003:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:7607:x1874188024430976:12345-0@lo:502: 00000100:00100000:1.0:1787365086.249262:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:7607:x1874188024430976:12345-0@lo:502: Request processed in 260us (590us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365086.249281:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787365086.249543:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024430976:0@lo:502: 00000040:00080000:3.0:1787365086.249915:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].1, 224 off8416 00000040:00080000:3.0:1787365086.249973:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].2, 112 off8528 00000100:00100000:3.0:1787365086.250136:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024431104:0@lo:502: 00000100:00100000:3.0:1787365086.250195:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365086.250232:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278fd563c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365086.250259:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024431104 00000100:00100000:3.0:1787365086.250274:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024431104 00000100:00100000:3.0:1787365086.250307:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:3.0:1787365086.250315:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:7607:x1874188024431104:12345-0@lo:502: 00000100:00100000:3.0:1787365086.250485:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:7607:x1874188024431104:12345-0@lo:502: Request processed in 169us (290us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365086.250491:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00100000:2.0:1787365086.250682:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f1f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024431104:0@lo:502: 00000040:00080000:2.0:1787365086.250780:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].3, 224 off8752 00000040:00080000:2.0:1787365086.250792:0:7607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 3 count 4 00000020:01000000:2.0:1787365086.251707:0:7619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787365086.251721:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365086.251724:0:7619:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:2.0:1787365086.251734:0:7619:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f27882fe000 00000020:00000080:2.0:1787365086.251737:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:2.0:1787365086.251760:0:7619:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787365086.251763:0:7619:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365086.251765:0:7619:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000040:00080000:2.0:1787365086.251768:0:7619:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000020:01000000:3.0:1787365086.251931:0:7607:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-3 (rc=0) 10000000:01000000:3.0:1787365086.251959:0:7607:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787365086.252007:0:7607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc600/0x872d29295eb46b8a lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46b91 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.252020:0:7607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc600/0x872d29295eb46b8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46b91 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365086.252081:0:7607:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:3.0:1787365086.252084:0:7607:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f27882fe000 10000000:01000000:3.0:1787365086.252087:0:7607:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f27882fe000 10000000:01000000:3.0:1787365086.252093:0:7607:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787365086.252100:0:7607:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f27882fe000 from 1 10000000:01000000:3.0:1787365086.252102:0:7607:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:3.0:1787365086.252143:0:7607:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f278f70aa00/0x872d29295eb46b98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.252152:0:7607:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f278f70aa00/0x872d29295eb46b98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.252163:0:7607:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f278f70aa00/0x872d29295eb46b98 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365086.252188:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024431232:0@lo:101: 00000100:00100000:3.0:1787365086.252254:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365086.252307:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278fd56c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787365086.252543:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024431232 00000100:00100000:2.0:1787365086.252551:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024431232 00000100:00100000:2.0:1787365086.252604:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:2.0:1787365086.252614:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:7607:x1874188024431232:12345-0@lo:101: 00010000:00010000:2.0:1787365086.252655:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365086.252679:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a12cc800/0x872d29295eb46b9f lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46b98 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.252707:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a12cc800/0x872d29295eb46b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46b98 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.252718:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a12cc800/0x872d29295eb46b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46b98 expref: 14 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.252728:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cc800, rc 0) 00000100:00100000:2.0:1787365086.252776:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:7607:x1874188024431232:12345-0@lo:101: Request processed in 164us (523us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365086.252783:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787365086.252933:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024431232:0@lo:101: 00010000:00010000:3.0:1787365086.252949:0:7607:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f278f70aa00/0x872d29295eb46b98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46b9f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.252958:0:7607:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f278f70aa00/0x872d29295eb46b98 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46b9f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365086.253256:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024431360:0@lo:501: 00000100:00100000:3.0:1787365086.253296:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365086.253378:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278fd56c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787365086.253587:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024431360 00000100:00100000:0.0:1787365086.253593:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024431360 00000100:00100000:2.0:1787365086.257154:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:2.0:1787365086.257190:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:7607:x1874188024431360:12345-0@lo:501: 00000100:00100000:2.0:1787365086.257661:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:7607:x1874188024431360:12345-0@lo:501: Request processed in 489us (4361us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365086.257670:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787365086.257883:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f2a00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024431360:0@lo:501: 00000100:00100000:0.0:1787365086.257954:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b56d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024431488:0@lo:503: 00000100:00100000:0.0:1787365086.258029:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365086.258089:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b64c6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787365086.258964:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024431488 00000100:00100000:2.0:1787365086.258976:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024431488 00000100:00100000:2.0:1787365086.259185:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787365086.259197:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:7607:x1874188024431488:12345-0@lo:503: 00000100:00100000:2.0:1787365086.262020:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:7607:x1874188024431488:12345-0@lo:503: Request processed in 2813us (3978us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365086.262036:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:0.0:1787365086.262279:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b56d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024431488:0@lo:503: 00000040:00080000:0.0:1787365086.262926:0:7607:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:0.0:1787365086.263174:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b56d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024431616:0@lo:502: 00000100:00100000:0.0:1787365086.263251:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365086.263352:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b64c6d80 going to sleep for 11 seconds 00000100:00100000:2.0:1787365086.263411:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024431616 00000100:00100000:2.0:1787365086.263418:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024431616 00000100:00100000:2.0:1787365086.263509:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787365086.263521:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:7607:x1874188024431616:12345-0@lo:502: 00000100:00100000:2.0:1787365086.263825:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:7607:x1874188024431616:12345-0@lo:502: Request processed in 306us (573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365086.263833:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787365086.263952:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b56d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024431616:0@lo:502: 00000040:00080000:0.0:1787365086.264258:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].1, 224 off8416 00000040:00080000:0.0:1787365086.264324:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].2, 120 off8536 00000040:00080000:0.0:1787365086.264358:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].3, 168 off8704 00000040:00080000:0.0:1787365086.264405:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].4, 224 off8928 00000040:00080000:0.0:1787365086.264443:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].5, 224 off9152 00000040:00080000:0.0:1787365086.264495:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].6, 120 off9272 00000040:00080000:0.0:1787365086.264531:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].7, 168 off9440 00000040:00080000:0.0:1787365086.264565:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].8, 224 off9664 00000040:00080000:0.0:1787365086.264611:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].9, 224 off9888 00000040:00080000:0.0:1787365086.264687:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].10, 120 off10008 00000040:00080000:0.0:1787365086.264723:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].11, 224 off10232 00000040:00080000:0.0:1787365086.264775:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].12, 224 off10456 00000040:00080000:0.0:1787365086.264812:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].13, 88 off10544 00000040:00080000:0.0:1787365086.264849:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].14, 128 off10672 00000040:00080000:0.0:1787365086.264898:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].15, 144 off10816 00000040:00080000:0.0:1787365086.264935:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].16, 160 off10976 00000040:00080000:0.0:1787365086.264967:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].17, 224 off11200 00000040:00080000:0.0:1787365086.265014:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].18, 224 off11424 00000040:00080000:0.0:1787365086.265049:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].19, 80 off11504 00000040:00080000:0.0:1787365086.265082:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].20, 224 off11728 00000040:00080000:0.0:1787365086.265127:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].21, 224 off11952 00000040:00080000:0.0:1787365086.265182:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].22, 88 off12040 00000040:00080000:0.0:1787365086.265216:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].23, 128 off12168 00000040:00080000:0.0:1787365086.265279:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].24, 144 off12312 00000040:00080000:0.0:1787365086.265329:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].25, 128 off12440 00000040:00080000:0.0:1787365086.265362:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].26, 224 off12664 00000040:00080000:0.0:1787365086.265411:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].27, 224 off12888 00000040:00080000:0.0:1787365086.265448:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].28, 80 off12968 00000040:00080000:0.0:1787365086.265481:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].29, 224 off13192 00000040:00080000:0.0:1787365086.265531:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].30, 224 off13416 00000040:00080000:0.0:1787365086.265572:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].31, 88 off13504 00000040:00080000:0.0:1787365086.265607:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].32, 128 off13632 00000040:00080000:0.0:1787365086.265687:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].33, 144 off13776 00000040:00080000:0.0:1787365086.265743:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 128 off13904 00000040:00080000:0.0:1787365086.265782:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 224 off14128 00000040:00080000:0.0:1787365086.265832:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14352 00000040:00080000:0.0:1787365086.265874:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].37, 80 off14432 00000100:00100000:0.0:1787365086.265932:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b56d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024431744:0@lo:502: 00000100:00100000:0.0:1787365086.266028:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365086.267372:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b64c6d80 going to sleep for 11 seconds 00000100:00100000:3.0:1787365086.267464:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024431744 00000100:00100000:3.0:1787365086.267473:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024431744 00000100:00100000:3.0:1787365086.267531:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 85 00000100:00100000:3.0:1787365086.267541:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:7607:x1874188024431744:12345-0@lo:502: 00000100:00100000:3.0:1787365086.267910:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:7607:x1874188024431744:12345-0@lo:502: Request processed in 369us (1881us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365086.267918:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 85 00000100:00100000:0.0:1787365086.268105:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b56d80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024431744:0@lo:502: 00000040:00080000:0.0:1787365086.268246:0:7607:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].38, 224 off14656 00000040:00080000:0.0:1787365086.268279:0:7607:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 38 count 39 00000020:01000004:0.0:1787365086.268992:0:7620:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:0.0:1787365086.269012:0:7620:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9f27bbec3370) 00000020:00000080:0.0:1787365086.269040:0:7620:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type lwp with refcount 2 00000020:01000004:0.0:1787365086.269216:0:7620:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f27882fe000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787365086.269221:0:7620:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f27882fe000 from lustre-OST0001, refs=3 00000020:01000004:0.0:1787365086.269224:0:7620:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f27882fe000 3 00010000:00080000:0.0:1787365086.269257:0:7620:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f27882fd000@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.113@tcp at head 00010000:00010000:0.0:1787365086.272897:0:7620:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-4 is initialized 00000020:00000080:1.0:1787365086.276942:0:7620:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:1.0:1787365086.277020:0:7620:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787365086.277039:0:7620:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x872d29295eb46bad 00000100:00080000:1.0:1787365086.277054:0:7620:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787365086.277063:0:7620:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f27882fd000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1787365086.277250:0:7620:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f2787323b80 x1874188024431872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787365086.277307:0:7620:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00100000:0.0:1787365086.277392:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874188024431872:0@lo:38: 00000100:00100000:0.0:1787365086.277484:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365086.277563:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024431872 00000100:00100000:0.0:1787365086.277577:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024431872 00000100:00100000:0.0:1787365086.277617:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787365086.277652:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1874188024431872:12345-0@lo:38: 00010000:00080000:0.0:1787365086.277680:0:5835:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 203 last 0 00000020:00000080:0.0:1787365086.277715:0:5835:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x872d29295eb46bb4 00000004:00100000:0.0:1787365086.277733:0:5835:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:0.0:1787365086.277946:0:5835:0:(import.c:65:import_set_state_nolock()) ffff9f2685887000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787365086.278139:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b56d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874188024431872:12345-0@lo:38: Request processed in 513us (653us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365086.278147:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:0.0:1787365086.278196:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f2787323b80 x1874188024431872/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787365096 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365086.278207:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787365086.278215:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 1 00000100:00080000:0.0:1787365086.278224:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:0.0:1787365086.278229:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:0.0:1787365086.278231:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9f27882fd000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:0.0:1787365086.278237:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787323b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874188024431872:0@lo:38: 00000100:00100000:3.0:1787365086.278862:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024432256:0@lo:400: 00000100:00100000:3.0:1787365086.278905:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365086.278948:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024432256 00000100:00100000:3.0:1787365086.278953:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024432256 00000100:00100000:3.0:1787365086.279006:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787365086.279015:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024432256:12345-0@lo:400: 00000100:00100000:3.0:1787365086.279059:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f0a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024432256:12345-0@lo:400: Request processed in 46us (154us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365086.279066:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:3.0:1787365086.279223:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bbdc5180 x1874188024432256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365086.279235:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024432256:0@lo:400: 00000100:00100000:0.0:1787365086.280911:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024432000:0@lo:400: 00000100:00100000:0.0:1787365086.281148:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365086.281199:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787365086.281207:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024432128:0@lo:400: 00000100:00100000:0.0:1787365086.281239:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365086.281301:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024432000 00000100:00100000:0.0:1787365086.281309:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024432000 00000100:00100000:0.0:1787365086.281355:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024432128 00000100:00100000:0.0:1787365086.281366:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024432128 00000100:00100000:0.0:1787365086.281393:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787365086.281401:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024432000:12345-0@lo:400: 00000100:00100000:0.0:1787365086.281460:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b57100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024432000:12345-0@lo:400: Request processed in 60us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365086.281467:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:0.0:1787365086.281489:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:0.0:1787365086.281495:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024432128:12345-0@lo:400: 00000100:00100000:0.0:1787365086.281522:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b54a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024432128:12345-0@lo:400: Request processed in 28us (283us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365086.281528:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:0.0:1787365086.281562:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bbdc5880 x1874188024432128/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365086.281576:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024432128:0@lo:400: 00010000:00080000:0.0:1787365086.281587:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bbdc7480 x1874188024432000/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365102 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365086.281595:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024432000:0@lo:400: 00000040:00080000:3.0:1787365086.293041:0:7620:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000020:01000000:1.0:1787365086.293451:0:7607:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-38 (rc=0) 10000000:01000000:1.0:1787365086.293489:0:7607:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787365086.293517:0:7607:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f278f70aa00/0x872d29295eb46b98 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46b9f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365086.293532:0:7607:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f278f70aa00/0x872d29295eb46b98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46b9f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787365086.293602:0:7607:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787365086.293605:0:7607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787365086.293607:0:7607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787365086.293608:0:7607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787365086.293610:0:7607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787365086.293611:0:7607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787365086.293613:0:7607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787365086.293615:0:7607:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787365086.293616:0:7607:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787365086.293618:0:7607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787365086.293619:0:7607:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787365086.293652:0:7607:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020062 00000020:01000004:1.0:1787365086.293656:0:7607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787365086.293657:0:7607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:1.0:1787365086.293659:0:7607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787365086.293660:0:7607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787365086.293661:0:7607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787365086.293662:0:7607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787365086.293663:0:7607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787365086.293664:0:7607:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:1.0:1787365086.293665:0:7607:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:1.0:1787365086.293666:0:7607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787365086.293667:0:7607:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787365086.293704:0:7607:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:1.0:1787365086.293730:0:7607:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787322300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024432384:0@lo:253: 00000100:00100000:1.0:1787365086.293858:0:7607:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365086.293916:0:7607:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bcfb9f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787365086.294227:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024432384 00000100:00100000:2.0:1787365086.294238:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024432384 00000100:00100000:2.0:1787365086.294308:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 86 00000100:00100000:2.0:1787365086.294319:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:7607:x1874188024432384:12345-0@lo:253: 20000000:01000000:2.0:1787365086.294353:0:5827:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:2.0:1787365086.294371:0:5827:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:0.0:1787365086.295968:0:7622:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b56300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7622:1874188024432512:0@lo:901: 00000100:00100000:0.0:1787365086.296061:0:7622:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365086.296169:0:7622:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6ae6240 going to sleep for 11 seconds 00000100:00100000:1.0:1787365086.296229:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024432512 00000100:00100000:1.0:1787365086.296237:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024432512 00000100:00100000:1.0:1787365086.296316:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787365086.296326:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7622:x1874188024432512:12345-0@lo:901: 00000100:00080000:2.0:1787365086.297089:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365086.297285:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b57b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:lustre-MDT0000-lwp-OST0001_UUID+5:7622:x1874188024432512:12345-0@lo:901: Request processed in 957us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365086.297295:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787365086.297445:0:7622:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f2786b56300 x1874188024432512/t0(0) o901->lustre-MDT0000-lwp-OST0001@0@lo:29/10 lens 248/4320 e 0 to 0 dl 1787365102 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365086.297464:0:7622:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b56300 pname:cluuid:pid:xid:nid:opc:job lwp_notify_lust:lustre-MDT0000-lwp-OST0001_UUID:7622:1874188024432512:0@lo:901: 20000000:01000000:2.0:1787365086.344749:0:5827:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:2.0:1787365086.344784:0:5827:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:3.0:1787365086.344896:0:5849:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787365086.344903:0:5849:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787365086.344951:0:5849:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bbb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.344973:0:5849:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f278f70bc00/0x872d29295eb46b0c lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46b05 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.344994:0:5849:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bbb lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.345047:0:5849:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f278f70bc00/0x872d29295eb46b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46b05 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.345064:0:5849:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f278f70bc00/0x872d29295eb46b0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46b05 expref: 14 pid: 5827 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365086.345202:0:5849:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874188024432640:0@lo:104: 00000100:00100000:3.0:1787365086.345304:0:5849:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365086.345363:0:5849:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27892abe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787365086.346414:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024432640 00000100:00100000:2.0:1787365086.346428:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024432640 00000100:00100000:2.0:1787365086.346503:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787365086.346514:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:5849:x1874188024432640:12345-0@lo:104: 00010000:00010000:2.0:1787365086.346532:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87400/0x872d29295eb46b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46b0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.346612:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787365086.346619:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:5849:x1874188024432640:12345-0@lo:104: Request processed in 108us (1316us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365086.346659:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00010000:3.0:1787365086.346770:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365086.346779:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87400/0x872d29295eb46b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46b0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.346787:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a0f87400 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:3.0:1787365086.346793:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87400/0x872d29295eb46b05 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46b0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.346803:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87400/0x872d29295eb46b05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46b0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787365086.346812:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87400/0x872d29295eb46b05 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46b0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365086.346838:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787365086.346890:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87400/0x872d29295eb46b05 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46b0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.346897:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787365086.346917:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87400/0x872d29295eb46b05 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46b0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.346925:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87400/0x872d29295eb46b05 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46b0c expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.346948:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365086.346950:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365086.346952:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365086.346967:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024432768:0@lo:103: 00000100:00100000:3.0:1787365086.347483:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365086.347576:0:5849:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f0e00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:5849:1874188024432640:0@lo:104: 00010000:00010000:3.0:1787365086.347607:0:5849:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bbb lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365086.347731:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024432768 00000100:00100000:2.0:1787365086.347738:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024432768 00010000:00010000:2.0:1787365086.347779:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f278f70bc00/0x872d29295eb46b0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46b05 expref: 15 pid: 5827 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365086.347810:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787365086.347828:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:3311:x1874188024432768:12345-0@lo:103: 00010000:00010000:2.0:1787365086.347842:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365086.347848:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f278f70bc00/0x872d29295eb46b0c lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46b05 expref: 15 pid: 5827 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.347859:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f278f70bc00/0x872d29295eb46b0c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46b05 expref: 15 pid: 5827 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.347876:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f278f70bc00/0x872d29295eb46b0c lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46b05 expref: 15 pid: 5827 timeout: 353 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.347892:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bbb lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.347902:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bbb lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787365086.347917:0:5820:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.003015513s 00010000:00010000:2.0:1787365086.347923:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bbb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.347930:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bbb lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.347936:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bbb lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.347943:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bbb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.347949:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f278f70a400 already unused, calling callback (ffffffffc1672420) 00010000:00010000:2.0:1787365086.347960:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bbb lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.347969:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bbb lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.348159:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bbb lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365086.348174:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365086.348216:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e19c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:3311:x1874188024432768:12345-0@lo:103: Request processed in 390us (735us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365086.348224:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787365086.348754:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024432768:0@lo:103: 00010000:00010000:3.0:1787365086.348790:0:5849:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bbb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.348797:0:5849:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bbb lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365086.348804:0:5849:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bbb lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 5849 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365086.356225:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:7607:x1874188024432384:12345-0@lo:253: Request processed in 61895us (62355us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365086.356244:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 86 00000100:00100000:3.0:1787365086.356565:0:7607:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787322300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:65f8cd6c-cad4-438a-a88d-c44efaabba70:7607:1874188024432384:0@lo:253: 10000000:01000000:3.0:1787365086.356586:0:7607:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787365086.356589:0:7607:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787365086.356591:0:7607:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787365086.356593:0:7607:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787365086.356594:0:7607:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787365086.356595:0:7607:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787365086.356596:0:7607:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787365086.356598:0:7607:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787365086.356600:0:7607:0:(tgt_mount.c:1192:server_mti_print()) LDD_F_VIRIGIN 00000020:01000004:3.0:1787365086.356601:0:7607:0:(tgt_mount.c:1194:server_mti_print()) LDD_F_UPDATE 00000020:01000004:3.0:1787365086.356603:0:7607:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787365086.356605:0:7607:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787365086.357231:0:7607:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:2.0:1787365086.366583:0:7607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:2.0:1787365086.367372:0:7607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:2.0:1787365086.367958:0:7607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:2.0:1787365086.368364:0:7607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:2.0:1787365086.368598:0:7607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:2.0:1787365086.369277:0:7607:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:2.0:1787365086.375211:0:7607:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00010000:00010000:1.0:1787365086.582448:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00080000:2.0:1787365086.639069:0:7607:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787365086.639080:0:7607:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787365086.639122:0:7607:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787365086.639197:0:7607:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787365086.639215:0:7607:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787365086.639253:0:7607:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:3.0:1787365087.606876:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365088.627962:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365089.651853:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365090.162820:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787365090.163930:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024432896:0@lo:13: 00000100:00100000:3.0:1787365090.164114:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365090.164247:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024432896 00000100:00100000:1.0:1787365090.164256:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024432896 00000100:00100000:1.0:1787365090.164327:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787365090.164337:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024432896:12345-0@lo:13: 00002000:00000024:1.0:1787365090.164372:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365090.164417:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024432896:12345-0@lo:13: Request processed in 82us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365090.164425:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:3.0:1787365090.164532:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787365090.164563:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2787323800 x1874188024432896/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365106 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365090.164582:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787323800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024432896:0@lo:13: 00010000:00010000:3.0:1787365090.675544:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365091.702346:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024433024:0@lo:400: 00000100:00100000:1.0:1787365091.702441:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365091.702868:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024433536:0@lo:400: 00000100:00100000:1.0:1787365091.702917:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365091.702955:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787365091.702960:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024433408:0@lo:400: 00000100:00100000:1.0:1787365091.702988:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365091.703036:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787322680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024433152:0@lo:400: 00000100:00100000:1.0:1787365091.703064:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365091.703082:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787365091.703088:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024433280:0@lo:400: 00000100:00100000:1.0:1787365091.703109:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365091.703141:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024433408 00000100:00100000:1.0:1787365091.703149:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024433408 00000100:00100000:1.0:1787365091.703205:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:1.0:1787365091.703215:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787322300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024433408:12345-0@lo:400: 00000100:00100000:1.0:1787365091.703547:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787322300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024433408:12345-0@lo:400: Request processed in 331us (556us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365091.703554:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:1.0:1787365091.703607:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2787320000 x1874188024433408/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365091.703622:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024433408:0@lo:400: 00000100:00100000:0.0:1787365091.703802:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024433536 00000100:00100000:0.0:1787365091.703808:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024433536 00000100:00100000:0.0:1787365091.703868:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024433152 00000100:00100000:0.0:1787365091.703872:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024433152 00000100:00100000:0.0:1787365091.703887:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024433280 00000100:00100000:0.0:1787365091.703889:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024433280 00000100:00100000:0.0:1787365091.703904:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787365091.703912:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024433536:12345-0@lo:400: 00000100:00100000:0.0:1787365091.703962:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787323800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024433536:12345-0@lo:400: Request processed in 52us (1044us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365091.703969:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787365091.703982:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787365091.703988:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787323b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024433152:12345-0@lo:400: 00000100:00100000:0.0:1787365091.704022:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787323b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024433152:12345-0@lo:400: Request processed in 35us (958us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365091.704028:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787365091.704037:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787365091.704042:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024433280:12345-0@lo:400: 00000100:00100000:0.0:1787365091.704068:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787320380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024433280:12345-0@lo:400: Request processed in 26us (959us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365091.704073:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787365091.704095:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:0.0:1787365091.704118:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2787320700 x1874188024433536/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365091.704127:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787320700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024433536:0@lo:400: 00010000:00080000:0.0:1787365091.704150:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2787321f80 x1874188024433280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365091.704158:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787321f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024433280:0@lo:400: 00010000:00080000:0.0:1787365091.704178:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2787322680 x1874188024433152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365107 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365091.704185:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787322680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024433152:0@lo:400: 00010000:00010000:0.0:1787365091.704258:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365091.709942:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024433024 00000100:00100000:0.0:1787365091.709963:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024433024 00000100:00100000:0.0:1787365091.710055:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787365091.710067:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:3313:x1874188024433024:12345-0@lo:400: 00000100:00100000:0.0:1787365091.710192:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:3313:x1874188024433024:12345-0@lo:400: Request processed in 127us (7750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365091.710200:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:0.0:1787365091.710331:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787322a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024433024:0@lo:400: 00010000:00010000:3.0:1787365092.722923:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787365093.232882:0:7963:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787365093.747783:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365094.770822:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365095.283113:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787365095.283151:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024433664:0@lo:13: 00000100:00100000:3.0:1787365095.283234:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365095.283403:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024433664 00000100:00100000:1.0:1787365095.283411:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024433664 00000100:00100000:1.0:1787365095.283489:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787365095.283499:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024433664:12345-0@lo:13: 00002000:00000024:1.0:1787365095.283533:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365095.283586:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024433664:12345-0@lo:13: Request processed in 89us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365095.283593:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787365095.283661:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2787320000 x1874188024433664/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365111 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365095.283676:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787320000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024433664:0@lo:13: 00000100:00080000:3.0:1787365095.284158:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787365095.794923:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787365096.306705:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787365096.306712:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f27a01d6000 from 30 10000000:01000000:2.0:1787365096.306723:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787365096.306764:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365096.306776:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365096.306789:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46bc2 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365096.306811:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024433792:0@lo:101: 00000100:00100000:2.0:1787365096.306878:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365096.307008:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024433792 00000100:00100000:3.0:1787365096.307024:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024433792 00000100:00100000:3.0:1787365096.307077:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:3.0:1787365096.307085:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:5832:x1874188024433792:12345-0@lo:101: 00010000:00010000:3.0:1787365096.307098:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365096.307111:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bc9 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46bc2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365096.307133:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46bc2 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365096.307143:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46bc2 expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365096.307151:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f278f70a400, rc 0) 00000100:00100000:3.0:1787365096.307188:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:5832:x1874188024433792:12345-0@lo:101: Request processed in 103us (309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365096.307204:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787365096.307359:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bb94c480 going to sleep for 11 seconds 00000100:00100000:2.0:1787365096.307381:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024433792:0@lo:101: 00010000:00010000:2.0:1787365096.307395:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46bc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46bc9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365096.307405:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46bc2 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46bc9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365096.307451:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024433920:0@lo:501: 00000100:00100000:2.0:1787365096.307477:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365096.307500:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bb94c480 going to sleep for 11 seconds 00000100:00100000:0.0:1787365096.307565:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024433920 00000100:00100000:0.0:1787365096.307570:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024433920 00000100:00100000:0.0:1787365096.307604:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:0.0:1787365096.307611:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:5832:x1874188024433920:12345-0@lo:501: 00000100:00100000:0.0:1787365096.308370:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:5832:x1874188024433920:12345-0@lo:501: Request processed in 757us (890us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365096.308379:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:2.0:1787365096.308444:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024433920:0@lo:501: 00000100:00100000:2.0:1787365096.308476:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024434048:0@lo:503: 00000100:00100000:2.0:1787365096.308518:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365096.308550:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bb94c480 going to sleep for 11 seconds 00000100:00100000:3.0:1787365096.308666:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024434048 00000100:00100000:3.0:1787365096.308671:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024434048 00000100:00100000:3.0:1787365096.308703:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 90 00000100:00100000:3.0:1787365096.308710:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:5832:x1874188024434048:12345-0@lo:503: 00000100:00100000:3.0:1787365096.312172:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:5832:x1874188024434048:12345-0@lo:503: Request processed in 3454us (3645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365096.312187:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 90 00000100:00100000:2.0:1787365096.312434:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024434048:0@lo:503: 00000100:00100000:2.0:1787365096.312840:0:8084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8084:1874188024434176:0@lo:502: 00000100:00100000:2.0:1787365096.312888:0:8084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365096.312936:0:8084:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bb94c240 going to sleep for 11 seconds 00000100:00100000:0.0:1787365096.313025:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024434176 00000100:00100000:0.0:1787365096.313032:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024434176 00000100:00100000:0.0:1787365096.313075:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787365096.313083:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:8084:x1874188024434176:12345-0@lo:502: 00000100:00100000:0.0:1787365096.313341:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:8084:x1874188024434176:12345-0@lo:502: Request processed in 258us (452us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365096.313355:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:2.0:1787365096.313423:0:8084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8084:1874188024434176:0@lo:502: 00000100:00100000:2.0:1787365096.313459:0:8084:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8084:1874188024434304:0@lo:502: 00000100:00100000:2.0:1787365096.313489:0:8084:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365096.313512:0:8084:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bb94c240 going to sleep for 11 seconds 00000100:00100000:0.0:1787365096.313547:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024434304 00000100:00100000:0.0:1787365096.313551:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024434304 00000100:00100000:0.0:1787365096.313579:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787365096.313585:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:8084:x1874188024434304:12345-0@lo:502: 00000100:00100000:0.0:1787365096.313730:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:8084:x1874188024434304:12345-0@lo:502: Request processed in 145us (240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365096.313738:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:2.0:1787365096.313857:0:8084:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc4e00 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8084:1874188024434304:0@lo:502: 00000040:00080000:2.0:1787365096.313875:0:8084:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:3.0:1787365096.314080:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:3.0:1787365096.314096:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787365096.314105:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46bc2 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46bc9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365096.314116:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46bc9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365096.314132:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:3.0:1787365096.314135:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 8 10000000:01000000:3.0:1787365096.314138:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:3.0:1787365096.314161:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f278f70a800/0x872d29295eb46bd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365096.314168:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f278f70a800/0x872d29295eb46bd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365096.314177:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f278f70a800/0x872d29295eb46bd0 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365096.314190:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024434432:0@lo:101: 00000100:00100000:3.0:1787365096.314231:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365096.314259:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2783143540 going to sleep for 11 seconds 00000100:00100000:0.0:1787365096.314302:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024434432 00000100:00100000:0.0:1787365096.314307:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024434432 00000100:00100000:0.0:1787365096.314337:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787365096.314344:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:5832:x1874188024434432:12345-0@lo:101: 00010000:00010000:0.0:1787365096.314352:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365096.314364:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2780030800/0x872d29295eb46bd7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46bd0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365096.314385:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2780030800/0x872d29295eb46bd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46bd0 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365096.314395:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2780030800/0x872d29295eb46bd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46bd0 expref: 15 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365096.314403:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780030800, rc 0) 00000100:00100000:0.0:1787365096.314443:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:5832:x1874188024434432:12345-0@lo:101: Request processed in 98us (210us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365096.314449:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:2.0:1787365096.314538:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024434432:0@lo:101: 00010000:00010000:2.0:1787365096.314550:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f278f70a800/0x872d29295eb46bd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46bd7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365096.314559:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f278f70a800/0x872d29295eb46bd0 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46bd7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365096.314598:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024434560:0@lo:501: 00000100:00100000:2.0:1787365096.314659:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365096.314681:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bb94c240 going to sleep for 11 seconds 00000100:00100000:0.0:1787365096.314765:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024434560 00000100:00100000:0.0:1787365096.314769:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024434560 00000100:00100000:0.0:1787365096.314808:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787365096.314814:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:5832:x1874188024434560:12345-0@lo:501: 00000100:00100000:0.0:1787365096.315192:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:5832:x1874188024434560:12345-0@lo:501: Request processed in 377us (532us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365096.315210:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00100000:3.0:1787365096.319107:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc4e00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024434560:0@lo:501: 00000100:00100000:3.0:1787365096.319169:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024434688:0@lo:503: 00000100:00100000:3.0:1787365096.319248:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365096.319503:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27831436c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787365096.321293:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024434688 00000100:00100000:0.0:1787365096.321303:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024434688 00000100:00100000:0.0:1787365096.321358:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787365096.321369:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:5832:x1874188024434688:12345-0@lo:503: 00000100:00100000:0.0:1787365096.321731:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:5832:x1874188024434688:12345-0@lo:503: Request processed in 364us (2483us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365096.321740:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:0.0:1787365096.321790:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024434688:0@lo:503: 00000100:00100000:0.0:1787365096.321997:0:8085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b56300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8085:1874188024434816:0@lo:502: 00000100:00100000:0.0:1787365096.322035:0:8085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365096.322055:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024434816 00000100:00100000:0.0:1787365096.322058:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024434816 00000100:00100000:0.0:1787365096.322077:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787365096.322082:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:8085:x1874188024434816:12345-0@lo:502: 00000100:00100000:0.0:1787365096.322226:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:8085:x1874188024434816:12345-0@lo:502: Request processed in 143us (190us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365096.322232:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00000100:00100000:0.0:1787365096.322265:0:8085:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27893e0b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787365096.322275:0:8085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b56300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8085:1874188024434816:0@lo:502: 00000020:01000000:0.0:1787365096.322296:0:8085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787365096.322305:0:8085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365096.322312:0:8085:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787365096.322319:0:8085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787365096.322321:0:8085:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:0.0:1787365096.322336:0:8085:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b56300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8085:1874188024434944:0@lo:502: 00000100:00100000:0.0:1787365096.322368:0:8085:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365096.322398:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024434944 00000100:00100000:0.0:1787365096.322401:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024434944 00000100:00100000:0.0:1787365096.322421:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787365096.322427:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:8085:x1874188024434944:12345-0@lo:502: 00000100:00100000:0.0:1787365096.322526:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:8085:x1874188024434944:12345-0@lo:502: Request processed in 98us (157us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365096.322532:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:0.0:1787365096.322560:0:8085:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b64c6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787365096.322571:0:8085:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b56300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8085:1874188024434944:0@lo:502: 00000020:01000000:0.0:1787365096.322588:0:8085:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787365096.322592:0:8085:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365096.322594:0:8085:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000040:00080000:0.0:1787365096.322598:0:8085:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000020:01000000:0.0:1787365096.322666:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 8-10 (rc=0) 10000000:01000000:0.0:1787365096.322681:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:0.0:1787365096.322690:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f278f70a800/0x872d29295eb46bd0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46bd7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365096.322700:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f278f70a800/0x872d29295eb46bd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46bd7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365096.322709:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:0.0:1787365096.322711:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f2797a7c800 from 30 10000000:01000000:0.0:1787365096.322713:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787365096.322740:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46bde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365096.322748:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46bde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365096.322757:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46bde lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365096.322767:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024435072:0@lo:101: 00000100:00100000:0.0:1787365096.322791:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365096.322804:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b64c6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787365096.322816:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024435072 00000100:00100000:0.0:1787365096.322818:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024435072 00000100:00100000:0.0:1787365096.322838:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787365096.322843:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:5832:x1874188024435072:12345-0@lo:101: 00010000:00010000:0.0:1787365096.322851:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365096.322861:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2780031400/0x872d29295eb46be5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46bde expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365096.322882:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2780031400/0x872d29295eb46be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46bde expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365096.322892:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2780031400/0x872d29295eb46be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46bde expref: 16 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365096.322900:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780031400, rc 0) 00000100:00100000:0.0:1787365096.322927:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:5832:x1874188024435072:12345-0@lo:101: Request processed in 84us (136us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365096.322933:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:0.0:1787365096.322964:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024435072:0@lo:101: 00010000:00010000:0.0:1787365096.322974:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46bde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46be5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365096.322982:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46bde lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46be5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365096.323013:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024435200:0@lo:501: 00000100:00100000:0.0:1787365096.323035:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365096.323045:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b64c6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787365096.323054:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024435200 00000100:00100000:0.0:1787365096.323057:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024435200 00000100:00100000:0.0:1787365096.323072:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787365096.323077:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:5832:x1874188024435200:12345-0@lo:501: 00000100:00100000:0.0:1787365096.323247:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:5832:x1874188024435200:12345-0@lo:501: Request processed in 169us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365096.323253:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787365096.323276:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024435200:0@lo:501: 00000100:00100000:0.0:1787365096.323294:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024435328:0@lo:503: 00000100:00100000:0.0:1787365096.323326:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365096.323338:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b64c6780 going to sleep for 11 seconds 00000100:00100000:0.0:1787365096.323347:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024435328 00000100:00100000:0.0:1787365096.323350:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024435328 00000100:00100000:0.0:1787365096.323366:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787365096.323370:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:5832:x1874188024435328:12345-0@lo:503: 00000100:00100000:0.0:1787365096.323473:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:5832:x1874188024435328:12345-0@lo:503: Request processed in 101us (146us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365096.323486:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787365096.323514:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024435328:0@lo:503: 00000100:00100000:1.0:1787365096.324448:0:8086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787320000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8086:1874188024435456:0@lo:502: 00000100:00100000:1.0:1787365096.324490:0:8086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365096.324519:0:8086:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bbb94300 going to sleep for 11 seconds 00000100:00100000:0.0:1787365096.324555:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024435456 00000100:00100000:0.0:1787365096.324559:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024435456 00000100:00100000:0.0:1787365096.324590:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:0.0:1787365096.324596:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:8086:x1874188024435456:12345-0@lo:502: 00000100:00100000:0.0:1787365096.324785:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:8086:x1874188024435456:12345-0@lo:502: Request processed in 187us (292us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365096.324791:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:2.0:1787365096.324894:0:8086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787320000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8086:1874188024435456:0@lo:502: 00000100:00100000:2.0:1787365096.324941:0:8086:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8086:1874188024435584:0@lo:502: 00000100:00100000:2.0:1787365096.324970:0:8086:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365096.324993:0:8086:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bb94cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787365096.325082:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024435584 00000100:00100000:0.0:1787365096.325086:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024435584 00000100:00100000:0.0:1787365096.325112:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:0.0:1787365096.325118:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:8086:x1874188024435584:12345-0@lo:502: 00000100:00100000:0.0:1787365096.325246:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:8086:x1874188024435584:12345-0@lo:502: Request processed in 127us (274us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365096.325252:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:2.0:1787365096.325332:0:8086:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8086:1874188024435584:0@lo:502: 00000040:00080000:2.0:1787365096.325354:0:8086:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000020:01000000:0.0:1787365096.325464:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 30-38 (rc=0) 10000000:01000000:0.0:1787365096.325479:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:0.0:1787365096.325487:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46bde lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46be5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365096.325498:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46bde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46be5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365096.325506:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:0.0:1787365096.325508:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f2797a7c800 from 5 10000000:01000000:0.0:1787365096.325511:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:0.0:1787365096.325536:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46bec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365096.325544:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46bec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365096.325553:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46bec lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365096.325564:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024435712:0@lo:101: 00000100:00100000:0.0:1787365096.325588:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365096.325652:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b64c66c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365096.325799:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024435712 00000100:00100000:1.0:1787365096.325803:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024435712 00000100:00100000:1.0:1787365096.325829:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787365096.325835:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:5832:x1874188024435712:12345-0@lo:101: 00010000:00010000:1.0:1787365096.325843:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365096.325854:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a0f86600/0x872d29295eb46bf3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46bec expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365096.325871:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a0f86600/0x872d29295eb46bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46bec expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365096.325880:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a0f86600/0x872d29295eb46bf3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46bec expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365096.325888:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a0f86600, rc 0) 00000100:00100000:2.0:1787365096.325994:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b56300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024435712:0@lo:101: 00010000:00010000:2.0:1787365096.326005:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46bec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46bf3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365096.326013:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46bec lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46bf3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365096.326050:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024435840:0@lo:256: 00000100:00100000:2.0:1787365096.326076:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365096.326094:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bb94cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787365096.326129:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024435712:12345-0@lo:101: Request processed in 293us (539us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365096.326135:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787365096.326150:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024435840 00000100:00100000:1.0:1787365096.326153:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024435840 00000100:00100000:1.0:1787365096.326165:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787365096.326170:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024435840:12345-0@lo:256: 20000000:01000000:1.0:1787365096.326180:0:5828:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787365096.326205:0:5828:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787365096.326208:0:5828:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 5 00000100:00100000:1.0:1787365096.326295:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024435840:12345-0@lo:256: Request processed in 123us (216us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365096.326302:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00100000:2.0:1787365096.326360:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024435840:0@lo:256: 10000000:01000000:2.0:1787365096.326401:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787365096.326406:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46bec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46bf3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365096.326413:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46bf3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365096.326420:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:2.0:1787365096.326422:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 25 10000000:01000000:2.0:1787365096.326424:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:2.0:1787365096.326442:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46bfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365096.326448:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46bfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365096.326464:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46bfa lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365096.326476:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024435968:0@lo:101: 00000100:00100000:2.0:1787365096.326499:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365096.326518:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bb94cb40 going to sleep for 11 seconds 00000100:00100000:0.0:1787365096.326559:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024435968 00000100:00100000:0.0:1787365096.326563:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024435968 00000100:00100000:0.0:1787365096.326589:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:0.0:1787365096.326594:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024435968:12345-0@lo:101: 00010000:00010000:0.0:1787365096.326600:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365096.326608:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2780030c00/0x872d29295eb46c01 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46bfa expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365096.326644:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2780030c00/0x872d29295eb46c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46bfa expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365096.326653:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2780030c00/0x872d29295eb46c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46bfa expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365096.326660:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780030c00, rc 0) 00000100:00100000:0.0:1787365096.326684:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024435968:12345-0@lo:101: Request processed in 90us (184us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365096.326689:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787365096.326757:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024435968:0@lo:101: 00010000:00010000:2.0:1787365096.326766:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46bfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46c01 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365096.326774:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46bfa lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46c01 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365096.326812:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024436096:0@lo:501: 00000100:00100000:2.0:1787365096.326837:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365096.326859:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bb94cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787365096.326870:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024436096 00000100:00100000:2.0:1787365096.326873:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024436096 00000100:00100000:2.0:1787365096.326888:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787365096.326893:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024436096:12345-0@lo:501: 00000100:00100000:2.0:1787365096.327087:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024436096:12345-0@lo:501: Request processed in 192us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365096.327093:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 106 00000100:00100000:2.0:1787365096.327116:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024436096:0@lo:501: 00000100:00100000:2.0:1787365096.327136:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024436224:0@lo:503: 00000100:00100000:2.0:1787365096.327171:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365096.327182:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bb94cb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787365096.327191:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024436224 00000100:00100000:2.0:1787365096.327205:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024436224 00000100:00100000:2.0:1787365096.327221:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787365096.327225:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024436224:12345-0@lo:503: 00000100:00100000:2.0:1787365096.327481:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024436224:12345-0@lo:503: Request processed in 254us (308us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365096.327488:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787365096.327523:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024436224:0@lo:503: 00000100:00100000:2.0:1787365096.327695:0:8087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8087:1874188024436352:0@lo:502: 00000100:00100000:2.0:1787365096.327726:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365096.327742:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024436352 00000100:00100000:2.0:1787365096.327745:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024436352 00000100:00100000:2.0:1787365096.327761:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787365096.327766:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:8087:x1874188024436352:12345-0@lo:502: 00000100:00100000:2.0:1787365096.327944:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:8087:x1874188024436352:12345-0@lo:502: Request processed in 176us (216us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365096.327950:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787365096.327983:0:8087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bb94cc00 going to sleep for 11 seconds 00000100:00100000:2.0:1787365096.327995:0:8087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc4a80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8087:1874188024436352:0@lo:502: 00000020:01000000:2.0:1787365096.328014:0:8087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787365096.328021:0:8087:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:2.0:1787365096.328027:0:8087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365096.328030:0:8087:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:2.0:1787365096.328038:0:8087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:2.0:1787365096.328046:0:8087:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:2.0:1787365096.328067:0:8087:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:2.0:1787365096.328069:0:8087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787365096.328083:0:8087:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9f27bafb19b8) 00000020:00000080:2.0:1787365096.328099:0:8087:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type osp with refcount 2 00000020:00000080:2.0:1787365096.328105:0:8087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:2.0:1787365096.328167:0:8087:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:2.0:1787365096.328172:0:8087:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:2.0:1787365096.328182:0:8087:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x872d29295eb46c0f 00010000:00080000:2.0:1787365096.328231:0:8087:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f27bbdba000@lustre-OST0001-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1787365096.328434:0:8087:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-5 is initialized 00000040:01000000:2.0:1787365096.328714:0:8087:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:01000000:2.0:1787365096.328724:0:8087:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:2.0:1787365096.329191:0:8087:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787365096.329397:0:8087:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787365096.329445:0:8087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].1, 64 off8256 00000040:00080000:2.0:1787365096.329499:0:8087:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].1, 64 off8256 00000040:00080000:2.0:1787365096.331136:0:8088:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787365096.331142:0:8088:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x6:0x0] at index 1 of catalog [0x1:0x5:0x0] 00000020:00000080:2.0:1787365096.332520:0:8087:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787365096.332532:0:8087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:2.0:1787365096.332565:0:8087:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:2.0:1787365096.332587:0:8087:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x872d29295eb46c16 00000100:00080000:2.0:1787365096.332598:0:8087:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787365096.332604:0:8087:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f27bbdba000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1787365096.332671:0:8087:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f27bbdc4a80 x1874188024436480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787365096.332690:0:8087:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:2.0:1787365096.332739:0:8087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787365096.332743:0:8087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365096.332750:0:8087:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:2.0:1787365096.332754:0:8087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787365096.332758:0:8087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365096.332760:0:8087:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:2.0:1787365096.332763:0:8087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:2.0:1787365096.332765:0:8087:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000100:00100000:2.0:1787365096.332794:0:8087:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8087:1874188024436608:0@lo:502: 00000100:00100000:2.0:1787365096.332868:0:8087:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365096.332904:0:8087:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bb94c780 going to sleep for 11 seconds 00000100:00100000:3.0:1787365096.333102:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024436736:0@lo:400: 00000100:00100000:3.0:1787365096.333134:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365096.333159:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787365096.333164:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874188024437120:0@lo:400: 00000100:00100000:3.0:1787365096.333189:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365096.333227:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024436864:0@lo:400: 00000100:00100000:3.0:1787365096.333249:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365096.333274:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787365096.333279:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024436992:0@lo:400: 00000100:00100000:3.0:1787365096.333313:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365096.333348:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024436736 00000100:00100000:3.0:1787365096.333354:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024436736 00000100:00100000:3.0:1787365096.333388:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024437120 00000100:00100000:3.0:1787365096.333391:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024437120 00000100:00100000:3.0:1787365096.333409:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024436864 00000100:00100000:3.0:1787365096.333411:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024436864 00000100:00100000:3.0:1787365096.333427:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787365096.333435:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024436736:12345-0@lo:400: 00000100:00100000:3.0:1787365096.333483:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024436736:12345-0@lo:400: Request processed in 48us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365096.333489:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787365096.333503:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787365096.333509:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874188024437120:12345-0@lo:400: 00000100:00100000:3.0:1787365096.333536:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874188024437120:12345-0@lo:400: Request processed in 27us (346us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365096.333542:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787365096.333552:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787365096.333557:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024436864:12345-0@lo:400: 00000100:00100000:3.0:1787365096.333582:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024436864:12345-0@lo:400: Request processed in 25us (332us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365096.333587:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787365096.333607:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024436992 00000100:00100000:3.0:1787365096.333610:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024436992 00000100:00100000:3.0:1787365096.333675:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787365096.333682:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024436992:12345-0@lo:400: 00000100:00100000:3.0:1787365096.333721:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb732680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024436992:12345-0@lo:400: Request processed in 39us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365096.333728:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787365096.333747:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787365096.333771:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb2f3b80 x1874188024437120/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365096.333783:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874188024437120:0@lo:400: 00010000:00080000:3.0:1787365096.333794:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb2f1180 x1874188024436736/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365096.333802:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024436736:0@lo:400: 00010000:00080000:3.0:1787365096.333834:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb2f3480 x1874188024436992/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365096.333842:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f3480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024436992:0@lo:400: 00010000:00080000:3.0:1787365096.333850:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb2f1880 x1874188024436864/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365112 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365096.333857:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024436864:0@lo:400: 00000100:00100000:2.0:1787365096.334044:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024436608 00000100:00100000:2.0:1787365096.334049:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024436608 00000100:00100000:2.0:1787365096.334076:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787365096.334083:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:8087:x1874188024436608:12345-0@lo:502: 00000100:00100000:2.0:1787365096.334326:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:8087:x1874188024436608:12345-0@lo:502: Request processed in 244us (1458us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365096.334333:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787365096.334376:0:8087:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc4700 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8087:1874188024436608:0@lo:502: 00000020:01000000:2.0:1787365096.334401:0:8087:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:2.0:1787365096.334407:0:8087:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365096.334409:0:8087:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000040:00080000:2.0:1787365096.334413:0:8087:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000020:01000000:2.0:1787365096.334523:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 25-33 (rc=0) 10000000:01000000:2.0:1787365096.334538:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787365096.334548:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46bfa lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46c01 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365096.334559:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46bfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46c01 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365096.334569:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787365096.334578:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f27872bb370 from 1 10000000:01000000:2.0:1787365096.334581:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787365096.334608:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46c1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365096.334616:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46c1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365096.334648:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46c1d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365096.334665:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024437248:0@lo:101: 00000100:00100000:2.0:1787365096.334697:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365096.334721:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bb94c780 going to sleep for 11 seconds 00000100:00100000:2.0:1787365096.334733:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024437248 00000100:00100000:2.0:1787365096.334737:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024437248 00000100:00100000:2.0:1787365096.334761:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787365096.334768:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024437248:12345-0@lo:101: 00010000:00010000:2.0:1787365096.334777:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365096.334789:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a12cd400/0x872d29295eb46c24 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46c1d expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365096.334810:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a12cd400/0x872d29295eb46c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46c1d expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365096.334820:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a12cd400/0x872d29295eb46c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46c1d expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365096.334829:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cd400, rc 0) 00000100:00100000:2.0:1787365096.334859:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:5832:x1874188024437248:12345-0@lo:101: Request processed in 90us (161us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365096.334871:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 110 00000100:00100000:2.0:1787365096.334902:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc4700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024437248:0@lo:101: 00000100:00100000:0.0:1787365096.335066:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024436480:0@lo:8: 00000100:00100000:0.0:1787365096.335099:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365096.335130:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024436480 00000100:00100000:0.0:1787365096.335133:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024436480 00000100:00100000:0.0:1787365096.335152:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787365096.335157:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:3309:x1874188024436480:12345-0@lo:8: 00010000:00080000:0.0:1787365096.335177:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 213 last 0 00000020:00000080:0.0:1787365096.335211:0:6681:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x872d29295eb46c2b 00002000:00100000:0.0:1787365096.335225:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9f2685881000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392e ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:0.0:1787365096.335229:0:6681:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00000001:00000004:0.0:1787365096.335233:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967296 00002000:00100000:0.0:1787365096.335342:0:6681:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:0.0:1787365096.335482:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787365096.335507:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9f2685882800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787365096.335550:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b56a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3309:x1874188024436480:12345-0@lo:8: Request processed in 390us (448us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365096.335557:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00010000:00080000:0.0:1787365096.335587:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bbdc4a80 x1874188024436480/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787365106 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365096.335595:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:0.0:1787365096.335602:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 1 00000100:00080000:0.0:1787365096.335609:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:0.0:1787365096.335614:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:0.0:1787365096.335617:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9f27bbdba000 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:0.0:1787365096.335646:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:0.0:1787365096.335651:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024436480:0@lo:8: 00010000:00010000:2.0:1787365096.337188:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46c1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46c24 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365096.337220:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46c1d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46c24 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365096.342735:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb733800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024437376:0@lo:501: 00000100:00100000:3.0:1787365096.342798:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365096.342834:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2783143840 going to sleep for 11 seconds 00000100:00100000:1.0:1787365096.342906:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024437376 00000100:00100000:1.0:1787365096.342914:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024437376 00000100:00100000:1.0:1787365096.343675:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787365096.343685:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:5832:x1874188024437376:12345-0@lo:501: 00000100:00100000:1.0:1787365096.344176:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:5832:x1874188024437376:12345-0@lo:501: Request processed in 492us (1377us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787365096.344184:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:1.0:1787365096.344241:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb733800 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024437376:0@lo:501: 10000000:01000000:1.0:1787365096.344268:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787365096.344277:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46c1d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46c24 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365096.344287:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46c24 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787365096.348312:0:8088:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:2.0:1787365096.348560:0:8088:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 213512933422ns, next at 0ns, rc = 0 00000004:00080000:1.0:1787365096.389093:0:8089:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787365096.389124:0:8089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787321180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8089:1874188024437632:0@lo:7: 00000100:00100000:1.0:1787365096.389191:0:8089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365096.389232:0:8089:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bbb94a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787365096.389252:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024437632 00000100:00100000:1.0:1787365096.389257:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024437632 00000100:00100000:1.0:1787365096.389311:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787365096.389321:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8089:x1874188024437632:12345-0@lo:7: 00000100:00100000:3.0:1787365096.390976:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024437504:0@lo:13: 00000100:00100000:3.0:1787365096.391036:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365096.392054:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024437504 00000100:00100000:2.0:1787365096.392063:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024437504 00000100:00100000:2.0:1787365096.392118:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787365096.392128:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874188024437504:12345-0@lo:13: 00002000:00000024:2.0:1787365096.392154:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3860856832 avail 3858759680 00000100:00100000:2.0:1787365096.392230:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb732300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3311:x1874188024437504:12345-0@lo:13: Request processed in 103us (1193us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365096.392237:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787365096.392257:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787365096.393398:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2787321c00 x1874188024437504/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365112 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365096.393419:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024437504:0@lo:13: 00002000:00080000:1.0:1787365096.398664:0:6682:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x0 00002000:00080000:1.0:1787365096.398678:0:6682:0:(ofd_dev.c:1208:ofd_get_info_hdl()) lustre-OST0001: LAST FID is [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787365096.398768:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787320a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:8089:x1874188024437632:12345-0@lo:7: Request processed in 9444us (9573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365096.398779:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00010000:00080000:1.0:1787365096.398827:0:8089:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2787321180 x1874188024437632/t0(0) o7->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 264/240 e 0 to 0 dl 1787365112 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365096.398842:0:8089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787321180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8089:1874188024437632:0@lo:7: 00000004:00080000:1.0:1787365096.398855:0:8089:0:(osp_precreate.c:810:osp_get_lastfid_from_ost()) lustre-OST0001-osc-MDT0000: Got last_fid [0x100010000:0x0:0x0] 00000100:00100000:1.0:1787365096.398888:0:8089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787321180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8089:1874188024437760:0@lo:5: 00000100:00100000:1.0:1787365096.398917:0:8089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365096.398940:0:8089:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bbb94a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787365096.398956:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024437760 00000100:00100000:1.0:1787365096.398961:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024437760 00000100:00100000:1.0:1787365096.398994:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787365096.399001:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8089:x1874188024437760:12345-0@lo:5: 00002000:00080000:1.0:1787365096.399022:0:6680:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 0 -> diff = 1 00002000:00080000:1.0:1787365096.399025:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 1 objects in group 0x0 at 1 00000100:00100000:1.0:1787365096.399222:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787321c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:8089:x1874188024437760:12345-0@lo:5: Request processed in 221us (303us total) trans 4294967297 rc 0/0 00000100:00100000:1.0:1787365096.399229:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00080000:1.0:1787365096.399257:0:8089:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2787321180 x1874188024437760/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787365112 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365096.399269:0:8089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787321180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8089:1874188024437760:0@lo:5: 00000004:00080000:1.0:1787365096.399277:0:8089:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x100010000:0x1:0x0] from OST, last_created [0x100010000:0x1:0x0]last_used is [0x100010000:0x1:0x0] 00000100:00100000:1.0:1787365096.399299:0:8089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787320000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8089:1874188024437888:0@lo:700: 00000100:00100000:1.0:1787365096.399322:0:8089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365096.399349:0:8089:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bbb94a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787365096.399362:0:6690:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024437888 00000100:00100000:1.0:1787365096.399367:0:6690:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024437888 00000100:00100000:1.0:1787365096.399393:0:6690:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787365096.399400:0:6690:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+7:8089:x1874188024437888:12345-0@lo:700: 00000100:00100000:1.0:1787365096.399425:0:6690:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787322680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6690:1874188024438016:0@lo:700: 00000100:00100000:1.0:1787365096.399453:0:6690:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365096.399470:0:6690:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bbb94000 going to sleep for 11 seconds 00000100:00100000:1.0:1787365096.399488:0:5840:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024438016 00000100:00100000:1.0:1787365096.399491:0:5840:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024438016 00000100:00100000:1.0:1787365096.399519:0:5840:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787365096.399525:0:5840:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6690:x1874188024438016:12345-0@lo:700: 00000004:00080000:3.0:1787365096.420323:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 40000000:02000000:2.0:1787365096.457346:0:5840:0:(fid_handler.c:119:__seq_server_alloc_super()) ctl-lustre-MDT0000: super-sequence allocation rc = 0 [0x0000000280000400-0x00000002c0000400]:1:ost 00000100:00100000:0.0:1787365096.463419:0:5840:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787321f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqs_0000:lustre-MDT0000-lwp-OST0001_UUID+5:6690:x1874188024438016:12345-0@lo:700: Request processed in 63886us (63956us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365096.463447:0:5840:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:1.0:1787365096.463577:0:6690:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2787322680 x1874188024438016/t0(0) o700->lustre-MDT0000-lwp-OST0001@0@lo:32/10 lens 264/248 e 0 to 0 dl 1787365112 ref 2 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365096.463592:0:6690:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787322680 pname:cluuid:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-lwp-OST0001_UUID:6690:1874188024438016:0@lo:700: 40000000:02000000:1.0:1787365096.463605:0:6690:0:(fid_request.c:122:seq_client_rpc()) cli-lustre-OST0001-super: Allocated super-sequence [0x0000000280000400-0x00000002c0000400]:1:ost] 00000001:00100000:0.0:1787365096.553649:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:0.0:1787365096.553665:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967297 is committed 00000100:00100000:3.0:1787365096.553800:0:6690:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787322a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_seq00_00:lustre-MDT0000-mdtlov_UUID+5:8089:x1874188024437888:12345-0@lo:700: Request processed in 154396us (154472us total) trans 0 rc 0/0 00010000:00080000:0.0:1787365096.553937:0:8089:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2787320000 x1874188024437888/t0(0) o700->lustre-OST0001-osc-MDT0000@0@lo:31/4 lens 264/248 e 0 to 0 dl 1787365112 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365096.553950:0:8089:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967297 gen 2 00000100:00100000:0.0:1787365096.553964:0:8089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787320000 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8089:1874188024437888:0@lo:700: 00000100:00100000:3.0:1787365096.554394:0:6690:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000004:02000040:0.0:1787365096.584583:0:8089:0:(osp_precreate.c:485:osp_precreate_rollover_new_seq()) lustre-OST0001-osc-MDT0000: update sequence from 0x100010000 to 0x280000400 00000100:00100000:2.0:1787365096.592736:0:8089:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8089:1874188024438144:0@lo:5: 00000100:00100000:2.0:1787365096.592804:0:8089:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365096.592853:0:8089:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bb94cb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787365096.592999:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024438144 00000100:00100000:1.0:1787365096.593007:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024438144 00000100:00100000:1.0:1787365096.593060:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787365096.593070:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:8089:x1874188024438144:12345-0@lo:5: 00002000:00080000:0.0:1787365096.621864:0:6680:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787365096.621883:0:6680:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 2 00000100:00100000:0.0:1787365096.624466:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:8089:x1874188024438144:12345-0@lo:5: Request processed in 31391us (31656us total) trans 4294967298 rc 0/0 00000100:00100000:0.0:1787365096.624479:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:3.0:1787365096.626438:0:8089:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bbdc4700 x1874188024438144/t0(0) o5->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 432/432 e 0 to 0 dl 1787365112 ref 2 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365096.626456:0:8089:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc4700 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:8089:1874188024438144:0@lo:5: 00000004:00080000:3.0:1787365096.626470:0:8089:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x1:0x0]-[0x280000400:0x21:0x0] 00010000:00010000:2.0:1787365096.819957:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365097.842941:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787365098.080662:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967298 is committed 00000100:00100000:3.0:1787365098.624504:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365098.624675:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003442816 00000100:00100000:1.0:1787365098.624688:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003442816 00000100:00100000:1.0:1787365098.624747:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 112 00000100:00100000:1.0:1787365098.624758:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1874188003442816:12345-192.168.203.13@tcp:250: 00010000:00080000:1.0:1787365098.624795:0:5829:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from c0d7a78e-143d-4100-8e74-6d9e2f230c05@192.168.203.13@tcp t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:1.0:1787365098.624831:0:5829:0:(genops.c:1385:class_connect()) connect: client c0d7a78e-143d-4100-8e74-6d9e2f230c05, cookie 0x872d29295eb46c32 00000100:00080000:1.0:1787365098.625032:0:5829:0:(import.c:65:import_set_state_nolock()) ffff9f27bb327000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787365098.625134:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+5:2358:x1874188003442816:12345-192.168.203.13@tcp:250: Request processed in 376us (644us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365098.625143:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 112 00000100:00100000:0.0:1787365098.645610:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365098.645742:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003442944 00000100:00100000:1.0:1787365098.645755:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003442944 00000100:00100000:1.0:1787365098.645825:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:1.0:1787365098.645846:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+5:5585:x1874188003442944:12345-192.168.203.13@tcp:101: 00010000:00010000:1.0:1787365098.645868:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365098.645896:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a0f87c00/0x872d29295eb46c39 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988ec9 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365098.645935:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a0f87c00/0x872d29295eb46c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ec9 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365098.645948:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a0f87c00/0x872d29295eb46c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ec9 expref: 6 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365098.645959:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a0f87c00, rc 0) 00000100:00100000:1.0:1787365098.646028:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+6:5585:x1874188003442944:12345-192.168.203.13@tcp:101: Request processed in 193us (432us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365098.646037:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:2.0:1787365098.654286:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365098.654426:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003443072 00000100:00100000:3.0:1787365098.654440:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003443072 00000100:00100000:3.0:1787365098.654504:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:3.0:1787365098.654515:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+6:5585:x1874188003443072:12345-192.168.203.13@tcp:501: 00000100:00100000:3.0:1787365098.656431:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+6:5585:x1874188003443072:12345-192.168.203.13@tcp:501: Request processed in 1906us (2146us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787365098.656446:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:3.0:1787365098.659148:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365098.659379:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003443200 00000100:00100000:0.0:1787365098.659405:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003443200 00000100:00100000:0.0:1787365098.659791:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:0.0:1787365098.659800:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+6:5585:x1874188003443200:12345-192.168.203.13@tcp:101: 00010000:00010000:0.0:1787365098.659815:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365098.659833:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2780030600/0x872d29295eb46c40 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988ed0 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365098.659863:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2780030600/0x872d29295eb46c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ed0 expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365098.659893:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2780030600/0x872d29295eb46c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ed0 expref: 7 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365098.659902:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780030600, rc 0) 00000100:00100000:0.0:1787365098.660006:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+7:5585:x1874188003443200:12345-192.168.203.13@tcp:101: Request processed in 207us (871us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365098.660013:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:3.0:1787365098.669786:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365098.670040:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003443328 00000100:00100000:0.0:1787365098.670053:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003443328 00000100:00100000:0.0:1787365098.670166:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:0.0:1787365098.670176:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+7:5585:x1874188003443328:12345-192.168.203.13@tcp:501: 00000100:00100000:0.0:1787365098.670761:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+8:5585:x1874188003443328:12345-192.168.203.13@tcp:501: Request processed in 585us (987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365098.670770:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:0.0:1787365098.684964:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365098.685074:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003443456 00000100:00100000:1.0:1787365098.685082:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003443456 00000100:00100000:1.0:1787365098.685169:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:1.0:1787365098.685188:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+8:5585:x1874188003443456:12345-192.168.203.13@tcp:503: 00000100:00100000:1.0:1787365098.685789:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+8:5585:x1874188003443456:12345-192.168.203.13@tcp:503: Request processed in 608us (831us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365098.685808:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:3.0:1787365098.694152:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365098.694515:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003443584 00000100:00100000:0.0:1787365098.694528:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003443584 00000100:00100000:0.0:1787365098.694612:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:0.0:1787365098.694669:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+8:5604:x1874188003443584:12345-192.168.203.13@tcp:502: 00000100:00100000:0.0:1787365098.695269:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+8:5604:x1874188003443584:12345-192.168.203.13@tcp:502: Request processed in 643us (1129us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365098.695279:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:3.0:1787365098.729430:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365098.730433:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003443712 00000100:00100000:1.0:1787365098.730448:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003443712 00000100:00100000:1.0:1787365098.730525:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:1.0:1787365098.730537:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+8:5604:x1874188003443712:12345-192.168.203.13@tcp:502: 00000100:00100000:1.0:1787365098.730870:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+8:5604:x1874188003443712:12345-192.168.203.13@tcp:502: Request processed in 334us (1453us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365098.730878:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:2.0:1787365098.740045:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365098.740236:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003443840 00000100:00100000:3.0:1787365098.740599:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003443840 00000100:00100000:3.0:1787365098.740675:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:3.0:1787365098.740686:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+8:5585:x1874188003443840:12345-192.168.203.13@tcp:101: 00010000:00010000:3.0:1787365098.740702:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365098.740721:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f278f70ae00/0x872d29295eb46c47 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988efa expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365098.740748:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f278f70ae00/0x872d29295eb46c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988efa expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365098.740776:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f278f70ae00/0x872d29295eb46c47 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988efa expref: 9 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365098.740785:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f278f70ae00, rc 0) 00000100:00100000:3.0:1787365098.740838:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+9:5585:x1874188003443840:12345-192.168.203.13@tcp:101: Request processed in 155us (801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365098.740845:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:3.0:1787365098.743301:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365098.744003:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003443968 00000100:00100000:0.0:1787365098.744023:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003443968 00000100:00100000:0.0:1787365098.744070:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:0.0:1787365098.744079:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+9:5585:x1874188003443968:12345-192.168.203.13@tcp:256: 20000000:01000000:0.0:1787365098.744118:0:5829:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787365098.744133:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787365098.744138:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787365098.744141:0:5829:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787365098.744144:0:5829:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:2.0:1787365098.753913:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+9:5585:x1874188003443968:12345-192.168.203.13@tcp:256: Request processed in 9818us (10602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365098.753928:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:0.0:1787365098.758392:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365098.758479:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003444096 00000100:00100000:1.0:1787365098.758488:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003444096 00000100:00100000:1.0:1787365098.758539:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:1.0:1787365098.758548:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+9:5585:x1874188003444096:12345-192.168.203.13@tcp:101: 00010000:00010000:1.0:1787365098.758566:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365098.758582:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a0f87200/0x872d29295eb46c4e lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988f01 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365098.758609:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a0f87200/0x872d29295eb46c4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f01 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365098.758620:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a0f87200/0x872d29295eb46c4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f01 expref: 10 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365098.758659:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a0f87200, rc 0) 00000100:00100000:1.0:1787365098.758707:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:5585:x1874188003444096:12345-192.168.203.13@tcp:101: Request processed in 160us (323us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365098.758714:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:3.0:1787365098.763295:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365098.764221:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003444224 00000100:00100000:2.0:1787365098.764232:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003444224 00000100:00100000:2.0:1787365098.764291:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:2.0:1787365098.764300:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:5585:x1874188003444224:12345-192.168.203.13@tcp:501: 00000100:00100000:2.0:1787365098.764574:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:5585:x1874188003444224:12345-192.168.203.13@tcp:501: Request processed in 274us (1287us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365098.764581:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:3.0:1787365098.767367:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365098.767443:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003444352 00000100:00100000:0.0:1787365098.767451:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003444352 00000100:00100000:0.0:1787365098.767503:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:0.0:1787365098.767512:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:5585:x1874188003444352:12345-192.168.203.13@tcp:503: 00000100:00100000:0.0:1787365098.767871:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:5585:x1874188003444352:12345-192.168.203.13@tcp:503: Request processed in 358us (510us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365098.767879:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:1.0:1787365098.774264:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365098.774652:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003444480 00000100:00100000:2.0:1787365098.774662:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003444480 00000100:00100000:2.0:1787365098.774713:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:2.0:1787365098.774723:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:5608:x1874188003444480:12345-192.168.203.13@tcp:502: 00000100:00100000:2.0:1787365098.774995:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:5608:x1874188003444480:12345-192.168.203.13@tcp:502: Request processed in 273us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365098.775004:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:1.0:1787365098.785020:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365098.785104:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003444608 00000100:00100000:0.0:1787365098.785113:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003444608 00000100:00100000:0.0:1787365098.785165:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00100000:0.0:1787365098.785175:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:5608:x1874188003444608:12345-192.168.203.13@tcp:502: 00000100:00100000:0.0:1787365098.785423:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:5608:x1874188003444608:12345-192.168.203.13@tcp:502: Request processed in 249us (421us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365098.785430:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00100000:2.0:1787365098.791995:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365098.792254:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003444736 00000100:00100000:2.0:1787365098.792263:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003444736 00000100:00100000:2.0:1787365098.792305:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:2.0:1787365098.792313:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:2358:x1874188003444736:12345-192.168.203.13@tcp:38: 00010000:00080000:2.0:1787365098.792341:0:5833:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp t0 exp 0000000000000000 cur 215 last 0 00000020:00000080:2.0:1787365098.792395:0:5833:0:(genops.c:1385:class_connect()) connect: client 8662a6a5-8ae3-4336-8479-3ba18dbc45ca, cookie 0x872d29295eb46c55 00000004:00100000:2.0:1787365098.792425:0:5833:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787365098.792430:0:5833:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967296 00000100:00080000:2.0:1787365098.824124:0:5833:0:(import.c:65:import_set_state_nolock()) ffff9f27bbdbe000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787365098.824229:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2358:x1874188003444736:12345-192.168.203.13@tcp:38: Request processed in 31914us (32242us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365098.824240:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00010000:00010000:2.0:1787365098.867783:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365099.831691:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365099.831724:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365099.831824:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003444864 00000100:00100000:0.0:1787365099.831834:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003444864 00000100:00100000:0.0:1787365099.831912:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003444992 00000100:00100000:0.0:1787365099.831915:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003444992 00000100:00100000:0.0:1787365099.831937:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:0.0:1787365099.831946:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:0:x1874188003444864:12345-192.168.203.13@tcp:41: 00000004:00000024:0.0:1787365099.831988:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787365099.832113:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787322680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:0:x1874188003444864:12345-192.168.203.13@tcp:41: Request processed in 167us (428us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365099.832120:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:0.0:1787365099.832136:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:0.0:1787365099.832143:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:5585:x1874188003444992:12345-192.168.203.13@tcp:41: 00000004:00000024:0.0:1787365099.832155:0:5834:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:0.0:1787365099.832186:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787320700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:5585:x1874188003444992:12345-192.168.203.13@tcp:41: Request processed in 43us (460us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365099.832192:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00080000:2.0:1787365099.832559:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365099.835502:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365099.835748:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003445120 00000100:00100000:3.0:1787365099.835758:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003445120 00000100:00100000:3.0:1787365099.835862:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1787365099.835873:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:5585:x1874188003445120:12345-192.168.203.13@tcp:40: 00000100:00100000:3.0:1787365099.835964:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b57800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:5585:x1874188003445120:12345-192.168.203.13@tcp:40: Request processed in 93us (471us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365099.835971:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:2.0:1787365099.839915:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365099.839963:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365099.840000:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003445248 00000100:00100000:1.0:1787365099.840009:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003445248 00000100:00100000:1.0:1787365099.840057:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1787365099.840065:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1874188003445248:12345-192.168.203.13@tcp:8: 00010000:00080000:1.0:1787365099.840093:0:6682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:1.0:1787365099.840122:0:6682:0:(genops.c:1385:class_connect()) connect: client 8662a6a5-8ae3-4336-8479-3ba18dbc45ca, cookie 0x872d29295eb46c5c 00002000:00100000:1.0:1787365099.840135:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8662a6a5-8ae3-4336-8479-3ba18dbc45ca/ffff9f27bb325000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787365099.840158:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787365099.840821:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787365099.840852:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9f27bb320800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787365099.841035:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2358:x1874188003445248:12345-192.168.203.13@tcp:8: Request processed in 969us (1127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365099.841044:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:0.0:1787365099.841121:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003445504 00000100:00100000:0.0:1787365099.841126:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003445504 00000100:00100000:0.0:1787365099.841168:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:0.0:1787365099.841186:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2362:x1874188003445504:12345-192.168.203.13@tcp:400: 00000100:00100000:0.0:1787365099.841215:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2362:x1874188003445504:12345-192.168.203.13@tcp:400: Request processed in 31us (1250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365099.841222:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:1.0:1787365099.845139:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365099.845226:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365099.846097:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003445376 00000100:00100000:3.0:1787365099.846106:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003445632 00000100:00100000:0.0:1787365099.846106:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003445376 00000100:00100000:3.0:1787365099.846109:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003445632 00000100:00100000:3.0:1787365099.846149:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1787365099.846149:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:0.0:1787365099.846156:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1874188003445376:12345-192.168.203.13@tcp:8: 00000100:00100000:3.0:1787365099.846157:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:5585:x1874188003445632:12345-192.168.203.13@tcp:33: 00010000:00080000:0.0:1787365099.846589:0:6680:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp t0 exp 0000000000000000 cur 217 last 0 00000020:00000080:0.0:1787365099.846623:0:6680:0:(genops.c:1385:class_connect()) connect: client 8662a6a5-8ae3-4336-8479-3ba18dbc45ca, cookie 0x872d29295eb46c63 00002000:00100000:0.0:1787365099.846666:0:6680:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8662a6a5-8ae3-4336-8479-3ba18dbc45ca/ffff9f2685883000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:0.0:1787365099.846689:0:6680:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:0.0:1787365099.847333:0:6680:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:0.0:1787365099.847365:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9f2685887800 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787365099.847434:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2358:x1874188003445376:12345-192.168.203.13@tcp:8: Request processed in 1277us (2207us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365099.847443:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000004:00080000:3.0:1787365099.880210:0:5836:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 33861us 00010000:00010000:0.0:1787365099.890911:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00200000:3.0:1787365099.894129:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:3.0:1787365099.894325:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:5585:x1874188003445632:12345-192.168.203.13@tcp:33: Request processed in 48162us (49190us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365099.894345:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1787365100.197814:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365100.198262:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003445760 00000100:00100000:2.0:1787365100.198272:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003445760 00000100:00100000:2.0:1787365100.198386:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:2.0:1787365100.198396:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:5625:x1874188003445760:12345-192.168.203.13@tcp:101: 00010000:00010000:2.0:1787365100.198414:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365100.199492:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb46c6a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988f2b expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.199747:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb46c71 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.199761:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb46c71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.199777:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb46c71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365100.201251:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787365100.201270:0:6704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365100.201412:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb46c71 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.201462:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb46c6a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f2b expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.201481:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb46c71 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f2b expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365100.201489:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f27988df000) 00010000:00010000:2.0:1787365100.201492:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787365100.201495:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cca00, rc 0) 00000100:00100000:2.0:1787365100.207246:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbb9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:5625:x1874188003445760:12345-192.168.203.13@tcp:101: Request processed in 3179us (3768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365100.207272:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:3.0:1787365100.403561:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024438272:0@lo:13: 00000100:00100000:3.0:1787365100.403659:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365100.404392:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024438272 00000100:00100000:2.0:1787365100.404402:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024438272 00000100:00100000:2.0:1787365100.404722:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787365100.404733:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024438272:12345-0@lo:13: 00002000:00000024:2.0:1787365100.404764:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365100.404844:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb733b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024438272:12345-0@lo:13: Request processed in 113us (1184us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365100.404852:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787365100.405082:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bbbb8e00 x1874188024438272/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365116 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365100.405103:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbb8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024438272:0@lo:13: 00000100:00080000:0.0:1787365100.406281:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787365100.919098:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787365100.977501:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8662a6a5-8ae3-4336-8479-3ba18dbc45ca 00000100:00100000:2.0:1787365101.426966:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024438528:0@lo:400: 00000100:00100000:2.0:1787365101.427035:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365101.427096:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024439040:0@lo:400: 00000100:00100000:2.0:1787365101.427138:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365101.427183:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787365101.427189:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024438656:0@lo:400: 00000100:00100000:2.0:1787365101.427213:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365101.427245:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024438528 00000100:00100000:2.0:1787365101.427254:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024438528 00000100:00100000:2.0:1787365101.427294:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024438656 00000100:00100000:2.0:1787365101.427297:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024438656 00000100:00100000:2.0:1787365101.427327:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787365101.427335:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024438528:12345-0@lo:400: 00000100:00100000:2.0:1787365101.427385:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024438528:12345-0@lo:400: Request processed in 50us (349us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365101.427392:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787365101.427407:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787365101.427413:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024438656:12345-0@lo:400: 00000100:00100000:2.0:1787365101.427440:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024438656:12345-0@lo:400: Request processed in 27us (226us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365101.427446:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1787365101.427464:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365101.427496:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024438656:0@lo:400: 00000100:00100000:2.0:1787365101.427507:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024438528:0@lo:400: 00000100:00100000:2.0:1787365101.427534:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024439040 00000100:00100000:2.0:1787365101.427538:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024439040 00000100:00100000:0.0:1787365101.427543:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024438784:0@lo:400: 00000100:00100000:2.0:1787365101.427569:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787365101.427575:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024439040:12345-0@lo:400: 00000100:00100000:2.0:1787365101.427610:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024439040:12345-0@lo:400: Request processed in 36us (471us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365101.427623:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00080000:2.0:1787365101.427664:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787365101.427683:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bbdc4a80 x1874188024439040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365101.427692:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967298 gen 2 00000100:00100000:2.0:1787365101.427702:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024439040:0@lo:400: 00000100:00100000:0.0:1787365101.427723:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365101.427744:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024438784 00000100:00100000:0.0:1787365101.427744:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787365101.427747:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024438784 00000100:00100000:0.0:1787365101.427750:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024438400:0@lo:400: 00000100:00100000:2.0:1787365101.427769:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787365101.427774:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024438784:12345-0@lo:400: 00000100:00100000:0.0:1787365101.427776:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365101.427797:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024438912:0@lo:400: 00000100:00100000:2.0:1787365101.427803:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b54700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024438784:12345-0@lo:400: Request processed in 28us (78us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365101.427808:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787365101.427819:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365101.427837:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024438400 00010000:00080000:0.0:1787365101.427839:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bbdc7b80 x1874188024438784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365117 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365101.427840:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024438400 00000100:00100000:0.0:1787365101.427849:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024438784:0@lo:400: 00000100:00100000:2.0:1787365101.427862:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787365101.427863:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024438912 00000100:00100000:0.0:1787365101.427866:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024438912 00000100:00100000:2.0:1787365101.427868:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024438400:12345-0@lo:400: 00000100:00100000:0.0:1787365101.427893:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787365101.427899:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024438912:12345-0@lo:400: 00000100:00100000:2.0:1787365101.427900:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024438400:12345-0@lo:400: Request processed in 31us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365101.427905:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:0.0:1787365101.427925:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b54000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024438912:12345-0@lo:400: Request processed in 26us (105us total) trans 0 rc 0/0 00000100:00080000:2.0:1787365101.427929:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365101.427930:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787365101.427942:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024438400:0@lo:400: 00000100:00100000:2.0:1787365101.427956:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024438912:0@lo:400: 00000100:00100000:2.0:1787365101.428103:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024439168:0@lo:13: 00000100:00100000:2.0:1787365101.428128:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365101.430096:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024439168 00000100:00100000:3.0:1787365101.430111:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024439168 00000100:00100000:3.0:1787365101.430190:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787365101.430202:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024439168:12345-0@lo:13: 00002000:00000024:3.0:1787365101.430231:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365101.430319:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024439168:12345-0@lo:13: Request processed in 121us (2189us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365101.430327:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00010000:00080000:0.0:1787365101.430443:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb731500 x1874188024439168/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365117 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365101.430463:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb731500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024439168:0@lo:13: 00010000:00010000:0.0:1787365101.938857:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365102.245526:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365102.247309:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003445888 00000100:00100000:2.0:1787365102.247329:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003445888 00000100:00100000:2.0:1787365102.247467:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:2.0:1787365102.247481:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:5678:x1874188003445888:12345-192.168.203.13@tcp:41: 00000004:00000024:2.0:1787365102.247550:0:6704:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261778432 avail 2259681280 00000100:00100000:2.0:1787365102.247722:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b54e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:5678:x1874188003445888:12345-192.168.203.13@tcp:41: Request processed in 243us (2212us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365102.247732:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00080000:0.0:1787365102.248176:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365102.255201:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365102.255305:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003446016 00000100:00100000:3.0:1787365102.255318:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003446016 00000100:00100000:3.0:1787365102.255417:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:3.0:1787365102.255432:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:5678:x1874188003446016:12345-192.168.203.13@tcp:13: 00002000:00000024:3.0:1787365102.255487:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365102.255585:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:5678:x1874188003446016:12345-192.168.203.13@tcp:13: Request processed in 157us (399us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365102.255594:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00080000:0.0:1787365102.256015:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787365102.258758:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365102.258917:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003446144 00000100:00100000:3.0:1787365102.258930:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003446144 00000100:00100000:3.0:1787365102.259029:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:3.0:1787365102.259042:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:5678:x1874188003446144:12345-192.168.203.13@tcp:13: 00002000:00000024:3.0:1787365102.259097:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365102.259224:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:5678:x1874188003446144:12345-192.168.203.13@tcp:13: Request processed in 185us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365102.259234:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00080000:0.0:1787365102.259320:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:2.0:1787365102.966548:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365103.995076:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787365104.029818:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8662a6a5-8ae3-4336-8479-3ba18dbc45ca 00000001:00100000:0.0:1787365104.042505:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8662a6a5-8ae3-4336-8479-3ba18dbc45ca 00010000:00010000:2.0:1787365105.011184:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365105.011758:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365105.011798:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365105.011821:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365105.011849:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365105.011989:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003446400 00000100:00100000:2.0:1787365105.011999:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003446400 00000100:00100000:2.0:1787365105.012070:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:2.0:1787365105.012081:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2361:x1874188003446400:12345-192.168.203.13@tcp:400: 00000100:00100000:2.0:1787365105.012163:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb732d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2361:x1874188003446400:12345-192.168.203.13@tcp:400: Request processed in 84us (411us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365105.012172:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:2.0:1787365105.012196:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003446656 00000100:00100000:2.0:1787365105.012200:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003446656 00000100:00100000:2.0:1787365105.012224:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003446528 00000100:00100000:2.0:1787365105.012227:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003446528 00000100:00100000:2.0:1787365105.012243:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:2.0:1787365105.012249:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2361:x1874188003446656:12345-192.168.203.13@tcp:400: 00000100:00100000:2.0:1787365105.012276:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb731c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2361:x1874188003446656:12345-192.168.203.13@tcp:400: Request processed in 27us (478us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365105.012282:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00080000:3.0:1787365105.012385:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787365105.012389:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787365105.012392:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365105.012425:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:2.0:1787365105.012443:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2361:x1874188003446528:12345-192.168.203.13@tcp:400: 00000100:00100000:2.0:1787365105.012470:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb730380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2361:x1874188003446528:12345-192.168.203.13@tcp:400: Request processed in 29us (621us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365105.012477:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:2.0:1787365105.012622:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003446272 00000100:00100000:2.0:1787365105.012692:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003446272 00000100:00100000:2.0:1787365105.012763:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 129 00000100:00100000:2.0:1787365105.012770:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2361:x1874188003446272:12345-192.168.203.13@tcp:400: 00000100:00100000:2.0:1787365105.012802:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2361:x1874188003446272:12345-192.168.203.13@tcp:400: Request processed in 32us (979us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365105.012808:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 129 00000001:02000400:2.0:1787365105.342822:0:8278:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00000100:00100000:1.0:1787365105.527669:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024439296:0@lo:13: 00000100:00100000:1.0:1787365105.527748:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365105.528322:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024439296 00000100:00100000:2.0:1787365105.528331:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024439296 00000100:00100000:2.0:1787365105.528525:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787365105.528537:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024439296:12345-0@lo:13: 00002000:00000024:2.0:1787365105.528575:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365105.528657:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024439296:12345-0@lo:13: Request processed in 122us (910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365105.528665:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:1.0:1787365105.528964:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787365105.529000:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bbdc6680 x1874188024439296/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365121 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365105.529021:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc6680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024439296:0@lo:13: 00010000:00010000:0.0:1787365106.034729:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365106.547099:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024439552:0@lo:400: 00000100:00100000:1.0:1787365106.547170:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024439424:0@lo:400: 00000100:00100000:3.0:1787365106.547182:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365106.547203:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365106.547241:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024440064:0@lo:400: 00000100:00100000:3.0:1787365106.547268:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365106.547277:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024439680:0@lo:400: 00000100:00100000:2.0:1787365106.547304:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365106.547327:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024440192:0@lo:13: 00000100:00100000:2.0:1787365106.547350:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365106.547379:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024440192 00000100:00100000:2.0:1787365106.547386:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024440192 00000100:00100000:2.0:1787365106.547445:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787365106.547453:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024440192:12345-0@lo:13: 00002000:00000024:2.0:1787365106.547484:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365106.547525:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024440192:12345-0@lo:13: Request processed in 73us (174us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365106.547532:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00010000:00080000:2.0:1787365106.547571:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bbdc4a80 x1874188024440192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365122 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365106.547587:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024440192:0@lo:13: 00000100:00100000:2.0:1787365106.547614:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024440064 00000100:00100000:2.0:1787365106.547618:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024440064 00000100:00100000:2.0:1787365106.547661:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787365106.547668:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024440064:12345-0@lo:400: 00000100:00100000:2.0:1787365106.547703:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024440064:12345-0@lo:400: Request processed in 36us (434us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365106.547710:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787365106.548037:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024439552 00000100:00100000:3.0:1787365106.548042:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024439552 00000100:00100000:3.0:1787365106.548076:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024439680 00000100:00100000:3.0:1787365106.548079:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024439680 00000100:00100000:3.0:1787365106.548100:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787365106.548107:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024439552:12345-0@lo:400: 00000100:00100000:3.0:1787365106.548156:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb730700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024439552:12345-0@lo:400: Request processed in 50us (974us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365106.548162:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787365106.548174:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787365106.548181:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024439680:12345-0@lo:400: 00000100:00100000:3.0:1787365106.548226:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024439680:12345-0@lo:400: Request processed in 46us (921us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365106.548232:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787365106.548282:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024439680:0@lo:400: 00000100:00100000:3.0:1787365106.548308:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024439552:0@lo:400: 00010000:00080000:3.0:1787365106.548318:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb730a80 x1874188024440064/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365106.548346:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024440064:0@lo:400: 00000100:00100000:3.0:1787365106.548381:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024439424 00000100:00100000:3.0:1787365106.548385:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024439424 00000100:00100000:3.0:1787365106.548409:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787365106.548415:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3313:x1874188024439424:12345-0@lo:400: 00000100:00100000:3.0:1787365106.548447:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3313:x1874188024439424:12345-0@lo:400: Request processed in 32us (1243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365106.548452:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 130 00000100:00100000:3.0:1787365106.548479:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024439808:0@lo:400: 00000100:00100000:3.0:1787365106.548505:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365106.548537:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024439808 00000100:00100000:3.0:1787365106.548540:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024439808 00000100:00100000:3.0:1787365106.548561:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787365106.548567:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024439808:12345-0@lo:400: 00000100:00100000:3.0:1787365106.548596:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024439808:12345-0@lo:400: Request processed in 29us (91us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365106.548601:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00010000:00080000:3.0:1787365106.548620:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb731180 x1874188024439808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365122 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365106.548646:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024439808:0@lo:400: 00000100:00100000:1.0:1787365106.551254:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024439424:0@lo:400: 00000100:00100000:1.0:1787365106.551271:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024439936:0@lo:400: 00000100:00100000:1.0:1787365106.551325:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787365106.552205:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787365106.552212:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787365106.552223:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024439936 00000100:00100000:1.0:1787365106.552230:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024439936 00000100:00100000:1.0:1787365106.552279:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787365106.552288:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024439936:12345-0@lo:400: 00000100:00080000:2.0:1787365106.553648:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365106.553798:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbb8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024439936:12345-0@lo:400: Request processed in 1507us (2468us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365106.553810:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787365106.553881:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024439936:0@lo:400: 00010000:00010000:2.0:1787365107.061922:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365108.082736:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365109.112361:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787365109.975151:0:8429:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde748c3f0 20000000:00000080:3.0:1787365109.975181:0:8429:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f27bb73f000 uarg=0000000000000000 20000000:01000000:3.0:1787365109.975233:0:8429:0:(mgs_llog.c:2006:mgs_parse_devname()) Device name lustre without fsname 20000000:01000000:3.0:1787365109.975235:0:8429:0:(mgs_llog.c:6069:mgs_set_conf_param()) lustre is seen as a file system name 20000000:01000000:3.0:1787365109.975238:0:8429:0:(mgs_llog.c:6100:mgs_set_conf_param()) set_conf_param fs='lustre' device='lustre' param='sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787365109.975244:0:8429:0:(mgs_llog.c:4748:mgs_write_log_param()) next param 'sys.jobid_var=procname_uid' 20000000:01000000:3.0:1787365109.975250:0:8429:0:(mgs_llog.c:4181:mgs_write_log_sys()) global 'sys.jobid_var=procname_uid' val=procname_uid 20000000:01000000:3.0:1787365109.975267:0:8429:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:3.0:1787365109.975270:0:8429:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 20000000:01000000:3.0:1787365109.975514:0:8429:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0001 20000000:01000000:3.0:1787365109.975518:0:8429:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0001/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787365109.986429:0:8430:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 8 count 8 00000040:00080000:3.0:1787365109.991398:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9632 00000040:00080000:3.0:1787365109.991497:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 120 off9752 00000040:00080000:3.0:1787365109.991557:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 224 off9976 20000000:01000000:3.0:1787365109.991576:0:8429:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-MDT0000 20000000:01000000:3.0:1787365109.991579:0:8429:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-MDT0000/lustre/sys.jobid_var fl=4 00000040:00080000:3.0:1787365109.995056:0:8431:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 34 count 34 00000040:00080000:1.0:1787365109.995773:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].34, 224 off14144 00000040:00080000:1.0:1787365109.995831:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].35, 120 off14264 00000040:00080000:1.0:1787365109.995887:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x4:0x0].36, 224 off14488 20000000:01000000:1.0:1787365109.995906:0:8429:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-OST0000 20000000:01000000:1.0:1787365109.995910:0:8429:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-OST0000/lustre/sys.jobid_var fl=4 00000040:00080000:1.0:1787365109.996912:0:8432:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 11 count 11 00000040:00080000:3.0:1787365109.997388:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].11, 224 off10160 00000040:00080000:3.0:1787365109.997460:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].12, 120 off10280 00000040:00080000:3.0:1787365109.997498:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].13, 224 off10504 20000000:01000000:3.0:1787365109.997512:0:8429:0:(mgs_llog.c:2550:mgs_write_log_direct_all()) Changing log lustre-client 20000000:01000000:3.0:1787365109.997515:0:8429:0:(mgs_llog.c:1109:mgs_modify()) modify lustre-client/lustre/sys.jobid_var fl=4 00000040:00080000:2.0:1787365109.998884:0:8433:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 39 count 39 00000040:00080000:1.0:1787365110.001849:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].39, 224 off14880 00000040:00080000:1.0:1787365110.001919:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].40, 120 off15000 00000040:00080000:1.0:1787365110.001976:0:8429:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x3:0x0].41, 224 off15224 10000000:01000000:1.0:1787365110.002004:0:8429:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x0 (lustre) 00010000:00010000:1.0:1787365110.005394:0:8429:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f27a0f87e00/0x872d29295eb46c78 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365110.005426:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f278f70b000/0x872d29295eb46b75 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46b6e expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365110.005436:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f27a12cc800/0x872d29295eb46b9f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46b98 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365110.005443:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bc9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46bc2 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365110.005450:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f2780030800/0x872d29295eb46bd7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46bd0 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365110.005457:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f2780031400/0x872d29295eb46be5 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46bde expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365110.005464:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f2780030c00/0x872d29295eb46c01 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46bfa expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365110.005470:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f27a12cd400/0x872d29295eb46c24 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46c1d expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365110.005481:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f27a0f87c00/0x872d29295eb46c39 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ec9 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365110.005489:0:8429:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f2780030600/0x872d29295eb46c40 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ed0 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365110.005522:0:8429:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f27a0f87e00/0x872d29295eb46c78 lrc: 12/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365110.005910:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f2780030600/0x872d29295eb46c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ed0 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365110.005930:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f2780030600/0x872d29295eb46c40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ed0 expref: 9 pid: 5829 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365110.005950:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbb8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874188024440320:192.168.203.13@tcp:104: 00010000:00010000:1.0:1787365110.006088:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f27a0f87c00/0x872d29295eb46c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ec9 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365110.006099:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f27a0f87c00/0x872d29295eb46c39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ec9 expref: 9 pid: 5828 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365110.006122:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbb9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874188024440448:192.168.203.13@tcp:104: 00010000:00010000:1.0:1787365110.006158:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f27a12cd400/0x872d29295eb46c24 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46c1d expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365110.006166:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f27a12cd400/0x872d29295eb46c24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46c1d expref: 18 pid: 5828 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365110.006175:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbbaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874188024440576:0@lo:104: 00000100:00100000:1.0:1787365110.006225:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787365110.006277:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f2780030c00/0x872d29295eb46c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46bfa expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365110.006299:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f2780030c00/0x872d29295eb46c01 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46bfa expref: 18 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365110.006308:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbbb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874188024440704:0@lo:104: 00000100:00100000:1.0:1787365110.006337:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787365110.006375:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f2780031400/0x872d29295eb46be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46bde expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365110.006383:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f2780031400/0x872d29295eb46be5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46bde expref: 18 pid: 5829 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365110.006391:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874188024440832:0@lo:104: 00010000:00010000:1.0:1787365110.006414:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f2780030800/0x872d29295eb46bd7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46bd0 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365110.006422:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f2780030800/0x872d29295eb46bd7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46bd0 expref: 18 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365110.006430:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbbbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874188024440960:0@lo:104: 00010000:00010000:1.0:1787365110.006453:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46bc2 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365110.006460:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bc9 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46bc2 expref: 18 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365110.006469:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbb9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874188024441088:0@lo:104: 00000100:00100000:2.0:1787365110.006470:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:1.0:1787365110.006487:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365110.006505:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787365110.006509:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f27a12cc800/0x872d29295eb46b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46b98 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365110.006518:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:1.0:1787365110.006525:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f27a12cc800/0x872d29295eb46b9f lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46b98 expref: 18 pid: 5829 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365110.006528:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024440576 00000100:00100000:2.0:1787365110.006536:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024440576 00000100:00100000:2.0:1787365110.006586:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024440704 00000100:00100000:2.0:1787365110.006589:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024440704 00000100:00100000:2.0:1787365110.006600:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024441088 00000100:00100000:2.0:1787365110.006609:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024441088 00000100:00100000:2.0:1787365110.006638:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024440832 00000100:00100000:2.0:1787365110.006641:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024440832 00000100:00100000:2.0:1787365110.006654:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024440960 00000100:00100000:2.0:1787365110.006656:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024440960 00000100:00100000:2.0:1787365110.006681:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787365110.006691:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+7:8429:x1874188024440576:12345-0@lo:104: 00010000:00010000:2.0:1787365110.006706:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46c24 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.006763:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787365110.006768:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbba680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+7:8429:x1874188024440576:12345-0@lo:104: Request processed in 79us (544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365110.006775:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787365110.006795:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787365110.006800:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb73dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+6:8429:x1874188024440704:12345-0@lo:104: 00010000:00010000:2.0:1787365110.006807:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46bfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46c01 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.006836:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787365110.006840:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb73dc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+6:8429:x1874188024440704:12345-0@lo:104: Request processed in 41us (503us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365110.006846:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787365110.006881:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787365110.006886:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+5:8429:x1874188024441088:12345-0@lo:104: 00010000:00010000:2.0:1787365110.006893:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46bc9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.006916:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787365110.006926:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbbad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+5:8429:x1874188024441088:12345-0@lo:104: Request processed in 40us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365110.006932:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787365110.006944:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787365110.006951:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+4:8429:x1874188024440832:12345-0@lo:104: 00010000:00010000:2.0:1787365110.006958:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46bde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46be5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.006984:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/4 locks to priority blp list, 4 blwis in pool 00000100:00100000:2.0:1787365110.006988:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+4:8429:x1874188024440832:12345-0@lo:104: Request processed in 39us (483us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365110.007005:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787365110.007018:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787365110.007024:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:8429:x1874188024440960:12345-0@lo:104: 00010000:00010000:2.0:1787365110.007031:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f278f70a800/0x872d29295eb46bd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46bd7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007065:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/5 locks to priority blp list, 5 blwis in pool 00000100:00100000:2.0:1787365110.007070:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:8429:x1874188024440960:12345-0@lo:104: Request processed in 47us (552us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365110.007076:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00010000:00010000:2.0:1787365110.007092:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 4 total in blp. (4 blwis in pool) 00010000:00010000:2.0:1787365110.007098:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46c24 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007114:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cc400 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:2.0:1787365110.007119:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46c1d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46c24 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007137:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46c1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46c24 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787365110.007145:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46c1d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46c24 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365110.007152:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787365110.007193:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46c1d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46c24 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007199:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787365110.007228:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46c1d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46c24 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007236:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46c1d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46c24 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007250:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 3 total in blp. (3 blwis in pool) 00010000:00010000:2.0:1787365110.007253:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46bfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46c01 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007259:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cc000 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:2.0:1787365110.007262:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46bfa lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46c01 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007268:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46bfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46c01 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787365110.007274:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46bfa lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46c01 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365110.007285:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787365110.007299:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46bfa lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46c01 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007304:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787365110.007309:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46bfa lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46c01 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007315:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46bfa lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46c01 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007322:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:2.0:1787365110.007325:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46bc9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007329:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cdc00 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:2.0:1787365110.007332:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46bc2 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46bc9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007338:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46bc9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787365110.007343:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46bc2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46bc9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365110.007348:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787365110.007357:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46bc2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46bc9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007363:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787365110.007385:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46bc2 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46bc9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007392:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46bc2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46bc9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007401:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:2.0:1787365110.007404:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46bde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46be5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007411:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030e00 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:2.0:1787365110.007413:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46bde lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46be5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007419:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46be5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787365110.007425:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46bde lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46be5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365110.007429:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787365110.007442:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46bde lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46be5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007448:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787365110.007453:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46bde lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46be5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007459:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46bde lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46be5 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007468:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787365110.007477:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f278f70a800/0x872d29295eb46bd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46bd7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007483:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f278f70a800 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:2.0:1787365110.007485:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f278f70a800/0x872d29295eb46bd0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46bd7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007492:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f278f70a800/0x872d29295eb46bd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46bd7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365110.007492:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024441344:0@lo:103: 10000000:00010000:2.0:1787365110.007498:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f278f70a800/0x872d29295eb46bd0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46bd7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365110.007503:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787365110.007516:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f278f70a800/0x872d29295eb46bd0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46bd7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007521:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787365110.007526:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f278f70a800/0x872d29295eb46bd0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46bd7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007532:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f278f70a800/0x872d29295eb46bd0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46bd7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.007543:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365110.007544:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787365110.007545:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365110.007547:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365110.007554:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365110.007563:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024441472:0@lo:103: 00000100:00100000:0.0:1787365110.007585:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024441856:0@lo:103: 00000100:00100000:2.0:1787365110.007590:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365110.007605:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365110.007618:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024441600:0@lo:103: 00000100:00100000:2.0:1787365110.007683:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365110.007700:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787365110.007705:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024441728:0@lo:103: 00000100:00100000:2.0:1787365110.007726:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365110.007750:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024441344 00000100:00100000:2.0:1787365110.007755:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024441344 00010000:00010000:2.0:1787365110.007779:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f27a12cd400/0x872d29295eb46c24 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46c1d expref: 19 pid: 5828 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365110.007796:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024441472 00000100:00100000:2.0:1787365110.007799:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024441472 00010000:00010000:2.0:1787365110.007810:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f2780030c00/0x872d29295eb46c01 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46bfa expref: 20 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365110.007820:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024441856 00000100:00100000:2.0:1787365110.007823:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024441856 00010000:00010000:2.0:1787365110.007832:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f2780030800/0x872d29295eb46bd7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46bd0 expref: 21 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365110.007842:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024441600 00000100:00100000:2.0:1787365110.007844:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024441600 00010000:00010000:2.0:1787365110.007852:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bc9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46bc2 expref: 22 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365110.007861:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024441728 00000100:00100000:2.0:1787365110.007863:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024441728 00010000:00010000:2.0:1787365110.007872:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f2780031400/0x872d29295eb46be5 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46bde expref: 23 pid: 5829 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365110.007883:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787365110.007889:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+23:3312:x1874188024441344:12345-0@lo:103: 00000100:00100000:3.0:1787365110.007908:0:5818:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 3 min 3 max 56 00010000:00010000:2.0:1787365110.007908:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365110.007914:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f27a12cd400/0x872d29295eb46c24 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46c1d expref: 23 pid: 5828 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365110.007915:0:5818:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_003' 00000100:00100000:0.0:1787365110.008210:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787365110.008220:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+23:3313:x1874188024441472:12345-0@lo:103: 00010000:00010000:0.0:1787365110.008230:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365110.008235:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f2780030c00/0x872d29295eb46c01 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 14 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46bfa expref: 23 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365110.008456:0:8434:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 4 min 3 max 56 00000100:00100000:3.0:1787365110.008462:0:8434:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_004' 00000100:00100000:1.0:1787365110.008601:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbb9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874188024441216:0@lo:104: 00010000:00010000:2.0:1787365110.008763:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f27a12cd400/0x872d29295eb46c24 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46c1d expref: 23 pid: 5828 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365110.008771:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787365110.008787:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787365110.008816:0:8429:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f278f70b000/0x872d29295eb46b75 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46b6e expref: 23 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365110.008825:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+23:3312:x1874188024441344:12345-0@lo:103: Request processed in 937us (1281us total) trans 0 rc 0/0 00010000:00010000:1.0:1787365110.008827:0:8429:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f278f70b000/0x872d29295eb46b75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46b6e expref: 23 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365110.008833:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787365110.008836:0:8429:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbbb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874188024441984:0@lo:104: 00000100:00100000:2.0:1787365110.008855:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787365110.008856:0:8429:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365110.008863:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+22:3312:x1874188024441856:12345-0@lo:103: 00010000:00010000:2.0:1787365110.008871:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787365110.008872:0:8429:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878a5d80 going to sleep for 11 seconds 00010000:00010000:2.0:1787365110.008875:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f2780030800/0x872d29295eb46bd7 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46bd0 expref: 22 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.008883:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f2780030800/0x872d29295eb46bd7 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 13 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46bd0 expref: 22 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.008892:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787365110.008896:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a12cd400/0x872d29295eb46c24 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46c1d expref: 22 pid: 5828 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365110.008907:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbbaa00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874188024440576:0@lo:104: 00000100:00100000:2.0:1787365110.008911:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+21:3312:x1874188024441856:12345-0@lo:103: Request processed in 51us (1306us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365110.008917:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787365110.008918:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbbb800 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874188024440704:0@lo:104: 00000100:00100000:1.0:1787365110.008926:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbba300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874188024440832:0@lo:104: 00000100:00100000:2.0:1787365110.008929:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787365110.008934:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+20:3310:x1874188024441600:12345-0@lo:103: 00010000:00010000:1.0:1787365110.008934:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2780030800/0x872d29295eb46bd7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46bd0 expref: 20 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.008942:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00000100:00100000:1.0:1787365110.008943:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbbbb80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874188024440960:0@lo:104: 00010000:00010000:2.0:1787365110.008946:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bc9 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46bc2 expref: 19 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365110.008951:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbb9500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874188024441088:0@lo:104: 00010000:00010000:2.0:1787365110.008962:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bc9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46bc2 expref: 19 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.008971:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f278f70a400/0x872d29295eb46bc9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46bc2 expref: 19 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.008980:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365110.009027:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:3310:x1874188024441600:12345-0@lo:103: Request processed in 92us (1343us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365110.009033:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787365110.009064:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024441600:0@lo:103: 00000100:00100000:2.0:1787365110.009170:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:2.0:1787365110.009178:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:3310:x1874188024441728:12345-0@lo:103: 00010000:00010000:2.0:1787365110.009187:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365110.009192:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f2780031400/0x872d29295eb46be5 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46bde expref: 17 pid: 5829 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.009200:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f2780031400/0x872d29295eb46be5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46bde expref: 17 pid: 5829 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.009210:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2780031400/0x872d29295eb46be5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46bde expref: 17 pid: 5829 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.009219:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365110.009241:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024441216 00000100:00100000:3.0:1787365110.009247:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024441216 00000100:00100000:2.0:1787365110.009248:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:3310:x1874188024441728:12345-0@lo:103: Request processed in 71us (1521us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365110.009253:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:3.0:1787365110.009272:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024441984 00000100:00100000:3.0:1787365110.009275:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024441984 00000100:00100000:3.0:1787365110.009288:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787365110.009293:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+4:8429:x1874188024441216:12345-0@lo:104: 00000100:00100000:2.0:1787365110.009295:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024441728:0@lo:103: 00010000:00010000:3.0:1787365110.009304:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f278f70aa00/0x872d29295eb46b98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46b9f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365110.009317:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024441856:0@lo:103: 00000100:00100000:2.0:1787365110.009333:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024441344:0@lo:103: 00010000:00010000:3.0:1787365110.009355:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1787365110.009358:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:3.0:1787365110.009360:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbb8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+4:8429:x1874188024441216:12345-0@lo:104: Request processed in 67us (589us total) trans 0 rc 0/0 00010000:00010000:2.0:1787365110.009364:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f278f70aa00/0x872d29295eb46b98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46b9f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365110.009367:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00010000:2.0:1787365110.009372:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f278f70aa00 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:2.0:1787365110.009376:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f278f70aa00/0x872d29295eb46b98 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46b9f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365110.009383:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787365110.009385:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f278f70aa00/0x872d29295eb46b98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46b9f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365110.009388:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:8429:x1874188024441984:12345-0@lo:104: 10000000:00010000:2.0:1787365110.009393:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f278f70aa00/0x872d29295eb46b98 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46b9f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365110.009395:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46b6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46b75 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365110.009400:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:3.0:1787365110.009425:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00010000:00010000:2.0:1787365110.009425:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f278f70aa00/0x872d29295eb46b98 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46b9f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365110.009430:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbbb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:8429:x1874188024441984:12345-0@lo:104: Request processed in 42us (573us total) trans 0 rc 0/0 00010000:00010000:2.0:1787365110.009432:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00000100:00100000:3.0:1787365110.009436:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:2.0:1787365110.009444:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f278f70aa00/0x872d29295eb46b98 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46b9f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.009451:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f278f70aa00/0x872d29295eb46b98 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46b9f expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.009460:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787365110.009464:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46b6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46b75 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.009479:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cd200 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:2.0:1787365110.009482:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46b6e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46b75 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.009488:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46b75 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787365110.009493:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46b6e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46b75 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365110.009498:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 00010000:00010000:2.0:1787365110.009511:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46b6e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46b75 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.009518:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787365110.009539:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46b6e lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46b75 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.009546:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46b6e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46b75 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.009560:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365110.009562:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365110.009563:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365110.009578:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787365110.009588:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024442240:0@lo:103: 00000100:00100000:2.0:1787365110.009621:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787365110.009669:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365110.009765:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024442112:0@lo:103: 00000100:00100000:2.0:1787365110.009798:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365110.009827:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024442240 00000100:00100000:2.0:1787365110.009831:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024442240 00010000:00010000:2.0:1787365110.009848:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f278f70b000/0x872d29295eb46b75 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46b6e expref: 16 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365110.009862:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024442112 00000100:00100000:2.0:1787365110.009864:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024442112 00010000:00010000:2.0:1787365110.009875:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f27a12cc800/0x872d29295eb46b9f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46b98 expref: 17 pid: 5829 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365110.009887:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787365110.009892:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:3311:x1874188024442240:12345-0@lo:103: 00010000:00010000:2.0:1787365110.009900:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365110.009905:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f278f70b000/0x872d29295eb46b75 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46b6e expref: 17 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.009914:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f278f70b000/0x872d29295eb46b75 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46b6e expref: 17 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.009925:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365110.009951:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31f480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:3311:x1874188024442240:12345-0@lo:103: Request processed in 58us (329us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365110.009957:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787365110.009969:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787365110.009975:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e18850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:3313:x1874188024442112:12345-0@lo:103: 00010000:00010000:2.0:1787365110.009983:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365110.009988:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f27a12cc800/0x872d29295eb46b9f lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46b98 expref: 16 pid: 5829 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365110.010268:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbb8000 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874188024440320:192.168.203.13@tcp:104: 00000100:00100000:1.0:1787365110.010278:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbb9f80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874188024440448:192.168.203.13@tcp:104: 00000100:00100000:1.0:1787365110.010286:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbb9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874188024441216:0@lo:104: 00010000:00010000:1.0:1787365110.010294:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f278f70b000/0x872d29295eb46b75 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46b6e expref: 16 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365110.010305:0:8429:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbbb100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8429:1874188024441984:0@lo:104: 00010000:00010000:1.0:1787365110.010339:0:8429:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f27a0f87e00/0x872d29295eb46c78 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.011900:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f27a12cc800/0x872d29295eb46b9f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46b98 expref: 15 pid: 5829 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.011921:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a12cc800/0x872d29295eb46b9f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46b98 expref: 15 pid: 5829 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365110.011936:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787365110.012134:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f2780030c00/0x872d29295eb46c01 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46bfa expref: 14 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365110.012148:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2780030c00/0x872d29295eb46c01 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46bfa expref: 14 pid: 5827 timeout: 377 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365110.012159:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365110.012247:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e18850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:3313:x1874188024442112:12345-0@lo:103: Request processed in 2269us (2445us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365110.012259:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787365110.012269:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc6680 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:3313:x1874188024441472:12345-0@lo:103: Request processed in 4053us (4678us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365110.012275:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787365110.012316:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024442240:0@lo:103: 00000100:00100000:0.0:1787365110.013137:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365110.013200:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365110.017702:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024442112:0@lo:103: 00000100:00100000:1.0:1787365110.017726:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024441472:0@lo:103: 00000100:00100000:3.0:1787365110.023340:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003446784 00000100:00100000:3.0:1787365110.023362:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003446784 00000100:00100000:1.0:1787365110.023872:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003446912 00000100:00100000:1.0:1787365110.023879:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003446912 00010000:00010000:1.0:1787365110.023930:0:8434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f27a0f87c00/0x872d29295eb46c39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ec9 expref: 11 pid: 5828 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365110.023971:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1787365110.023982:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0d7a78e-143d-4100-8e74-6d9e2f230c05+11:2361:x1874188003446912:12345-192.168.203.13@tcp:103: 00010000:00010000:1.0:1787365110.024002:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365110.024008:0:8434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f27a0f87c00/0x872d29295eb46c39 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ec9 expref: 11 pid: 5828 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365110.024022:0:8434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f27a0f87c00/0x872d29295eb46c39 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ec9 expref: 11 pid: 5828 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365110.024072:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a0f87c00/0x872d29295eb46c39 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ec9 expref: 11 pid: 5828 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365110.024089:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365110.024182:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b55c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2361:x1874188003446912:12345-192.168.203.13@tcp:103: Request processed in 199us (10979us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365110.024190:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00010000:00010000:3.0:1787365110.025067:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f2780030600/0x872d29295eb46c40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ed0 expref: 9 pid: 5829 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365110.025125:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:3.0:1787365110.025135:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+9:2362:x1874188003446784:12345-192.168.203.13@tcp:103: 00010000:00010000:3.0:1787365110.025148:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365110.025154:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f2780030600/0x872d29295eb46c40 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ed0 expref: 9 pid: 5829 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365110.025167:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f2780030600/0x872d29295eb46c40 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ed0 expref: 9 pid: 5829 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365110.025200:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2780030600/0x872d29295eb46c40 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ed0 expref: 9 pid: 5829 timeout: 327 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365110.025218:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f27a0f87e00/0x872d29295eb46c78 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365110.025228:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a0f87e00/0x872d29295eb46c78 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365110.025245:0:5820:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f27a0f87e00/0x872d29295eb46c78 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365110.025252:0:5820:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f27a0f87e00/0x872d29295eb46c78 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365110.025260:0:5820:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f27a0f87e00/0x872d29295eb46c78 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365110.025268:0:5820:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f27a0f87e00/0x872d29295eb46c78 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365110.025274:0:5820:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a0f87e00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365110.025279:0:5820:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f27a0f87e00/0x872d29295eb46c78 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365110.025287:0:5820:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f27a0f87e00/0x872d29295eb46c78 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365110.025302:0:5820:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f27a0f87e00/0x872d29295eb46c78 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365110.025322:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365110.025383:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b57480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+8:2362:x1874188003446784:12345-192.168.203.13@tcp:103: Request processed in 250us (12252us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365110.025391:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00010000:00010000:1.0:1787365110.025750:0:8429:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f27a0f87e00/0x872d29295eb46c78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365110.025762:0:8429:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f27a0f87e00/0x872d29295eb46c78 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365110.025768:0:8429:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a0f87e00/0x872d29295eb46c78 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8429 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365110.130839:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365110.130877:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365110.130925:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365110.130959:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003447296 00000100:00100000:0.0:1787365110.130969:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003447296 00000100:00100000:0.0:1787365110.131028:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003447168 00000100:00100000:0.0:1787365110.131030:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003447168 00000100:00100000:0.0:1787365110.131048:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:0.0:1787365110.131061:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2362:x1874188003447296:12345-192.168.203.13@tcp:400: 00000100:00100000:0.0:1787365110.131161:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b54380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2362:x1874188003447296:12345-192.168.203.13@tcp:400: Request processed in 103us (281us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365110.131169:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:0.0:1787365110.131188:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:0.0:1787365110.131195:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2362:x1874188003447168:12345-192.168.203.13@tcp:400: 00000100:00100000:0.0:1787365110.131220:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c2680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2362:x1874188003447168:12345-192.168.203.13@tcp:400: Request processed in 26us (295us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365110.131227:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00010000:00010000:1.0:1787365110.131748:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365110.131953:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003447040 00000100:00100000:2.0:1787365110.131961:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003447040 00000100:00100000:2.0:1787365110.132011:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:2.0:1787365110.132019:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2362:x1874188003447040:12345-192.168.203.13@tcp:400: 00000100:00100000:2.0:1787365110.132068:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b55180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2362:x1874188003447040:12345-192.168.203.13@tcp:400: Request processed in 49us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365110.132075:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00080000:2.0:1787365110.132092:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787365110.132096:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787365110.132098:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787365110.643064:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024442368:0@lo:13: 00000100:00100000:0.0:1787365110.643174:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365110.643480:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024442368 00000100:00100000:2.0:1787365110.643490:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024442368 00000100:00100000:2.0:1787365110.643583:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787365110.643594:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024442368:12345-0@lo:13: 00000100:00080000:0.0:1787365110.643912:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00000024:2.0:1787365110.643938:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365110.644010:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024442368:12345-0@lo:13: Request processed in 417us (835us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365110.644036:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00010000:00080000:0.0:1787365110.644152:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb31e300 x1874188024442368/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365126 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365110.644187:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024442368:0@lo:13: 00010000:00010000:3.0:1787365111.155000:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:2.0:1787365111.219197:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787365111.219207:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f27882fe000 from 39 10000000:01000000:2.0:1787365111.219214:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787365111.219279:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46c7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.219297:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46c7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.219311:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46c7f lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365111.219344:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024442496:0@lo:101: 00000100:00100000:2.0:1787365111.219438:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365111.220159:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5d000 going to sleep for 11 seconds 00000100:00100000:1.0:1787365111.220584:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024442496 00000100:00100000:1.0:1787365111.220595:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024442496 00000100:00100000:1.0:1787365111.228199:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 131 00000100:00100000:1.0:1787365111.228232:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+12:5832:x1874188024442496:12345-0@lo:101: 00010000:00010000:1.0:1787365111.228260:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365111.228286:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a0f87e00/0x872d29295eb46c86 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46c7f expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.228327:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a0f87e00/0x872d29295eb46c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46c7f expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.228340:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a0f87e00/0x872d29295eb46c86 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46c7f expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.228370:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a0f87e00, rc 0) 00000100:00100000:1.0:1787365111.228482:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:5832:x1874188024442496:12345-0@lo:101: Request processed in 268us (9044us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365111.228490:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 131 00000100:00100000:2.0:1787365111.229316:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024442496:0@lo:101: 00010000:00010000:2.0:1787365111.229349:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46c7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46c86 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.229362:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46c7f lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46c86 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365111.229475:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024442624:0@lo:501: 00000100:00100000:2.0:1787365111.229542:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365111.229599:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5d000 going to sleep for 11 seconds 00000100:00100000:3.0:1787365111.230189:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024442624 00000100:00100000:3.0:1787365111.230197:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024442624 00000100:00100000:3.0:1787365111.230259:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:3.0:1787365111.230268:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:5832:x1874188024442624:12345-0@lo:501: 00000100:00100000:3.0:1787365111.230621:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:5832:x1874188024442624:12345-0@lo:501: Request processed in 354us (1079us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365111.230701:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:2.0:1787365111.233049:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024442624:0@lo:501: 00000100:00100000:2.0:1787365111.233146:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024442752:0@lo:503: 00000100:00100000:2.0:1787365111.233252:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365111.233305:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5d000 going to sleep for 11 seconds 00000100:00100000:1.0:1787365111.233417:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024442752 00000100:00100000:1.0:1787365111.233427:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024442752 00000100:00100000:1.0:1787365111.233500:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:1.0:1787365111.233510:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:5832:x1874188024442752:12345-0@lo:503: 00000100:00100000:1.0:1787365111.234338:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:5832:x1874188024442752:12345-0@lo:503: Request processed in 824us (1081us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365111.234349:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787365111.235147:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31d880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024442752:0@lo:503: 00000100:00100000:0.0:1787365111.236015:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8447:1874188024442880:0@lo:502: 00000100:00100000:0.0:1787365111.236118:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365111.236170:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2787828300 going to sleep for 11 seconds 00000100:00100000:1.0:1787365111.236577:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024442880 00000100:00100000:1.0:1787365111.236589:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024442880 00000100:00100000:1.0:1787365111.236677:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:1.0:1787365111.236687:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:8447:x1874188024442880:12345-0@lo:502: 00000100:00100000:1.0:1787365111.237242:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:8447:x1874188024442880:12345-0@lo:502: Request processed in 555us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365111.237252:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:0.0:1787365111.237850:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8447:1874188024442880:0@lo:502: 00000100:00100000:0.0:1787365111.237928:0:8447:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8447:1874188024443008:0@lo:502: 00000100:00100000:0.0:1787365111.237978:0:8447:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365111.238026:0:8447:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2787828300 going to sleep for 11 seconds 00000100:00100000:2.0:1787365111.238462:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024443008 00000100:00100000:2.0:1787365111.238470:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024443008 00000100:00100000:2.0:1787365111.238529:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 135 00000100:00100000:2.0:1787365111.238540:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:8447:x1874188024443008:12345-0@lo:502: 00000100:00100000:2.0:1787365111.239367:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:8447:x1874188024443008:12345-0@lo:502: Request processed in 825us (1386us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365111.239377:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 135 00000100:00100000:0.0:1787365111.239565:0:8447:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c2300 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8447:1874188024443008:0@lo:502: 00000040:00080000:0.0:1787365111.239605:0:8447:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787365111.240343:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787365111.240368:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787365111.240381:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46c7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46c86 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.240395:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46c7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46c86 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365111.240406:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0001 10000000:01000000:2.0:1787365111.240410:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 8 10000000:01000000:2.0:1787365111.240413:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:2.0:1787365111.240453:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46c8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.240461:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46c8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.240472:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46c8d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365111.240493:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024443136:0@lo:101: 00000100:00100000:2.0:1787365111.240560:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365111.240603:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365111.240690:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024443136 00000100:00100000:3.0:1787365111.240698:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024443136 00000100:00100000:3.0:1787365111.240758:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 136 00000100:00100000:3.0:1787365111.240768:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+13:5832:x1874188024443136:12345-0@lo:101: 00010000:00010000:3.0:1787365111.240782:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365111.240798:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2788f44600/0x872d29295eb46c94 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46c8d expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.241050:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2788f44600/0x872d29295eb46c94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46c8d expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.241064:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2788f44600/0x872d29295eb46c94 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46c8d expref: 14 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.241074:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44600, rc 0) 00000100:00100000:3.0:1787365111.241140:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:5832:x1874188024443136:12345-0@lo:101: Request processed in 373us (579us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365111.241147:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 136 00000100:00100000:0.0:1787365111.241280:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024443136:0@lo:101: 00010000:00010000:0.0:1787365111.241296:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46c8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46c94 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365111.241306:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46c8d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46c94 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365111.241364:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024443264:0@lo:501: 00000100:00100000:0.0:1787365111.241394:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365111.241475:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2787828300 going to sleep for 11 seconds 00000100:00100000:1.0:1787365111.246294:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024443264 00000100:00100000:1.0:1787365111.246315:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024443264 00000100:00100000:1.0:1787365111.246444:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787365111.246458:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:5832:x1874188024443264:12345-0@lo:501: 00000100:00100000:1.0:1787365111.248393:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:5832:x1874188024443264:12345-0@lo:501: Request processed in 1928us (6986us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365111.248410:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:0.0:1787365111.253068:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024443264:0@lo:501: 00000100:00100000:0.0:1787365111.253171:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024443392:0@lo:503: 00000100:00100000:0.0:1787365111.253284:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365111.253333:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2787828300 going to sleep for 11 seconds 00000100:00100000:1.0:1787365111.254019:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024443392 00000100:00100000:1.0:1787365111.254034:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024443392 00000100:00100000:1.0:1787365111.254152:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787365111.254165:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:5832:x1874188024443392:12345-0@lo:503: 00000100:00100000:1.0:1787365111.254434:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:5832:x1874188024443392:12345-0@lo:503: Request processed in 272us (1150us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365111.254442:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00000100:00100000:2.0:1787365111.259453:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c2300 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024443392:0@lo:503: 00000100:00100000:2.0:1787365111.260291:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8448:1874188024443520:0@lo:502: 00000100:00100000:2.0:1787365111.260392:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365111.260447:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5de40 going to sleep for 11 seconds 00000100:00100000:3.0:1787365111.260513:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024443520 00000100:00100000:3.0:1787365111.260522:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024443520 00000100:00100000:3.0:1787365111.260583:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:3.0:1787365111.260594:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:8448:x1874188024443520:12345-0@lo:502: 00000100:00100000:3.0:1787365111.261198:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:8448:x1874188024443520:12345-0@lo:502: Request processed in 605us (805us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365111.261208:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00100000:2.0:1787365111.264749:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31ca80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8448:1874188024443520:0@lo:502: 00000020:01000000:3.0:1787365111.274796:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787365111.274959:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365111.274963:0:8448:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787365111.274980:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787365111.275049:0:8448:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb731180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8448:1874188024443648:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787365111.275177:0:8448:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365111.275235:0:8448:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bbb94840 going to sleep for 11 seconds 00000100:00100000:2.0:1787365111.275331:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024443648 00000100:00100000:2.0:1787365111.275340:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024443648 00000100:00100000:2.0:1787365111.275400:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 140 00000100:00100000:2.0:1787365111.275410:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:8448:x1874188024443648:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787365111.275727:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:8448:x1874188024443648:12345-0@lo:502:llog_process_th.0 Request processed in 317us (550us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365111.275748:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 140 00000100:00100000:0.0:1787365111.276138:0:8448:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb731180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8448:1874188024443648:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787365111.276178:0:8448:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787365111.276185:0:8448:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365111.276188:0:8448:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787365111.276197:0:8448:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 11 count 11 00000020:01000000:2.0:1787365111.277992:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 8-10 (rc=0) 10000000:01000000:2.0:1787365111.278065:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787365111.278081:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46c8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46c94 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.278193:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46c8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46c94 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365111.278208:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787365111.278211:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f27a01d6000 from 39 10000000:01000000:2.0:1787365111.278215:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787365111.278272:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46c9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.278305:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46c9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.278319:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46c9b lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365111.278349:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024443776:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787365111.278432:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365111.278534:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5d3c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365111.283033:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024443776 00000100:00100000:1.0:1787365111.283054:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024443776 00000100:00100000:1.0:1787365111.283196:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 141 00000100:00100000:1.0:1787365111.283208:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:5832:x1874188024443776:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787365111.283231:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365111.283255:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a0f87c00/0x872d29295eb46ca2 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46c9b expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.283291:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a0f87c00/0x872d29295eb46ca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46c9b expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.283304:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a0f87c00/0x872d29295eb46ca2 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46c9b expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.283315:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a0f87c00, rc 0) 00000100:00100000:1.0:1787365111.283428:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:5832:x1874188024443776:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 222us (4995us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365111.283436:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 141 00000100:00100000:3.0:1787365111.283540:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024443776:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787365111.283564:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46c9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ca2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.283575:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46c9b lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46ca2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365111.283697:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb733480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024443904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365111.283746:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365111.295139:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bbb94a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787365111.298806:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024443904 00000100:00100000:2.0:1787365111.299117:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024443904 00000100:00100000:2.0:1787365111.299203:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:2.0:1787365111.299216:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:5832:x1874188024443904:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787365111.299658:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:5832:x1874188024443904:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 444us (15910us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365111.299676:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787365111.299847:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb733480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024443904:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365111.299922:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb733480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024444032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787365111.299977:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365111.300020:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bbb94a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787365111.300203:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024444032 00000100:00100000:2.0:1787365111.300208:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024444032 00000100:00100000:2.0:1787365111.300235:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:2.0:1787365111.300241:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:5832:x1874188024444032:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787365111.300417:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:5832:x1874188024444032:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 174us (439us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365111.300425:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787365111.302043:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb733480 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024444032:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787365111.303150:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb733480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8449:1874188024444160:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787365111.303246:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365111.303335:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bbb94780 going to sleep for 11 seconds 00000100:00100000:0.0:1787365111.307278:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024444160 00000100:00100000:0.0:1787365111.307298:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024444160 00000100:00100000:2.0:1787365111.309496:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787365111.309529:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:8449:x1874188024444160:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787365111.310240:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:8449:x1874188024444160:12345-0@lo:502:llog_process_th.0 Request processed in 726us (6990us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365111.310252:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:3.0:1787365111.316137:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb733480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8449:1874188024444160:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787365111.316406:0:8449:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8449:1874188024444288:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787365111.316508:0:8449:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365111.316564:0:8449:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787365111.316679:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024444288 00000100:00100000:3.0:1787365111.316687:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024444288 00000100:00100000:3.0:1787365111.317969:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 145 00000100:00100000:3.0:1787365111.317989:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:8449:x1874188024444288:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787365111.318365:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:8449:x1874188024444288:12345-0@lo:502:llog_process_th.0 Request processed in 383us (1856us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365111.318374:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 145 00000100:00100000:2.0:1787365111.318498:0:8449:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8449:1874188024444288:0@lo:502:llog_process_th.0 00000040:00080000:2.0:1787365111.318539:0:8449:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787365111.318655:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:2.0:1787365111.318672:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787365111.318685:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46c9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ca2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.318698:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46c9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ca2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365111.318709:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-OST0000 10000000:01000000:2.0:1787365111.318712:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 11 10000000:01000000:2.0:1787365111.318716:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:2.0:1787365111.318762:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46ca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.318771:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46ca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.318781:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46ca9 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365111.320972:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024444416:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787365111.321073:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365111.321354:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5d480 going to sleep for 11 seconds 00000100:00100000:1.0:1787365111.325583:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024444416 00000100:00100000:1.0:1787365111.325604:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024444416 00000100:00100000:1.0:1787365111.325698:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:1.0:1787365111.325708:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:5832:x1874188024444416:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787365111.325761:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365111.325786:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a0f86800/0x872d29295eb46cb0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46ca9 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.326018:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a0f86800/0x872d29295eb46cb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46ca9 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.326031:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a0f86800/0x872d29295eb46cb0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46ca9 expref: 16 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.326042:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a0f86800, rc 0) 00000100:00100000:1.0:1787365111.326155:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:5832:x1874188024444416:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 449us (5082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365111.326162:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:2.0:1787365111.326273:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024444416:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787365111.326295:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46ca9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46cb0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.326305:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46ca9 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46cb0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365111.326384:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024444544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787365111.326423:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365111.326462:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5d480 going to sleep for 11 seconds 00000100:00100000:1.0:1787365111.326579:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024444544 00000100:00100000:1.0:1787365111.326583:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024444544 00000100:00100000:1.0:1787365111.326602:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:1.0:1787365111.326608:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:5832:x1874188024444544:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787365111.327244:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:5832:x1874188024444544:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 631us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365111.327253:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:2.0:1787365111.327335:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024444544:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787365111.327372:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024444672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787365111.327420:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365111.327448:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5d480 going to sleep for 11 seconds 00000100:00100000:3.0:1787365111.327505:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024444672 00000100:00100000:3.0:1787365111.327511:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024444672 00000100:00100000:3.0:1787365111.327540:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787365111.327548:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:5832:x1874188024444672:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787365111.327961:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024444672:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787365111.328026:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:5832:x1874188024444672:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 479us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365111.328035:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00100000:3.0:1787365111.328473:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb733480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8450:1874188024444800:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787365111.328518:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365111.328561:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bbb943c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787365111.328608:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024444800 00000100:00100000:2.0:1787365111.328615:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024444800 00000100:00100000:2.0:1787365111.328673:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 149 00000100:00100000:2.0:1787365111.328680:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:8450:x1874188024444800:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787365111.329128:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:8450:x1874188024444800:12345-0@lo:502:llog_process_th.0 Request processed in 447us (608us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365111.329145:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 149 00000100:00100000:3.0:1787365111.329281:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb733480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8450:1874188024444800:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787365111.329312:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787365111.329324:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365111.329327:0:8450:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:3.0:1787365111.329338:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:3.0:1787365111.329363:0:8450:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb733480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8450:1874188024444928:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787365111.329401:0:8450:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365111.329432:0:8450:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bbb943c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787365111.329475:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024444928 00000100:00100000:2.0:1787365111.329480:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024444928 00000100:00100000:2.0:1787365111.329510:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 150 00000100:00100000:2.0:1787365111.329518:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:8450:x1874188024444928:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787365111.329676:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:8450:x1874188024444928:12345-0@lo:502:llog_process_th.0 Request processed in 158us (274us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365111.329683:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 150 00000100:00100000:3.0:1787365111.330005:0:8450:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb733480 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8450:1874188024444928:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787365111.330028:0:8450:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787365111.330032:0:8450:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365111.330034:0:8450:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:3.0:1787365111.330041:0:8450:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 14 count 14 00000020:01000000:2.0:1787365111.330985:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 11-13 (rc=0) 10000000:01000000:2.0:1787365111.331015:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:2.0:1787365111.331029:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46ca9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46cb0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.331043:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46ca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46cb0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365111.331055:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-client 10000000:01000000:2.0:1787365111.331059:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f2797a7c800 from 39 10000000:01000000:2.0:1787365111.331062:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787365111.331116:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb46cb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.331126:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb46cb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.331137:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb46cb7 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365111.331159:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024445056:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787365111.331228:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365111.331270:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5d9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365111.331344:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024445056 00000100:00100000:3.0:1787365111.331350:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024445056 00000100:00100000:3.0:1787365111.331426:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:3.0:1787365111.331435:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:5832:x1874188024445056:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787365111.331448:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365111.331464:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2788f44e00/0x872d29295eb46cbe lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46cb7 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.331491:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2788f44e00/0x872d29295eb46cbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46cb7 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.331504:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2788f44e00/0x872d29295eb46cbe lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46cb7 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.331514:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44e00, rc 0) 00000100:00100000:3.0:1787365111.331565:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024445056:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (337us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365111.331572:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:2.0:1787365111.331656:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024445056:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787365111.331670:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb46cb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46cbe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.331680:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb46cb7 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46cbe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365111.331729:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024445184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787365111.331769:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365111.339622:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5d9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787365111.339828:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024445184 00000100:00100000:0.0:1787365111.339840:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024445184 00000100:00100000:2.0:1787365111.342035:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:2.0:1787365111.342052:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024445184:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787365111.342452:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024445184:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 402us (10679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365111.342461:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787365111.342600:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024445184:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787365111.342706:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024445312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787365111.342880:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365111.342919:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2787828f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787365111.343037:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024445312 00000100:00100000:2.0:1787365111.343045:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024445312 00000100:00100000:2.0:1787365111.343075:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:2.0:1787365111.343081:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024445312:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787365111.343328:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024445312:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 245us (447us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365111.343338:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00100000:0.0:1787365111.345971:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c3b80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024445312:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787365111.346544:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8451:1874188024445440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787365111.346659:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365111.346715:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2787828d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787365111.346830:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024445440 00000100:00100000:1.0:1787365111.346837:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024445440 00000100:00100000:1.0:1787365111.346893:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 154 00000100:00100000:1.0:1787365111.346902:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:8451:x1874188024445440:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787365111.347206:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:8451:x1874188024445440:12345-0@lo:502:llog_process_th.0 Request processed in 304us (547us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365111.347225:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 154 00000100:00100000:0.0:1787365111.347443:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8451:1874188024445440:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787365111.347497:0:8451:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8451:1874188024445568:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787365111.347534:0:8451:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365111.347563:0:8451:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2787828d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787365111.347610:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024445568 00000100:00100000:1.0:1787365111.347615:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024445568 00000100:00100000:1.0:1787365111.347676:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 155 00000100:00100000:1.0:1787365111.347683:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:8451:x1874188024445568:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787365111.347843:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:8451:x1874188024445568:12345-0@lo:502:llog_process_th.0 Request processed in 159us (308us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365111.347850:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 155 00000100:00100000:0.0:1787365111.349965:0:8451:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c3b80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8451:1874188024445568:0@lo:502:llog_process_th.0 00000040:00080000:0.0:1787365111.350027:0:8451:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000100:00100000:3.0:1787365111.350571:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365111.350600:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003447424 00000100:00100000:3.0:1787365111.350607:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003447424 00000100:00100000:3.0:1787365111.350682:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 156 00000100:00100000:3.0:1787365111.350693:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+8:5599:x1874188003447424:12345-192.168.203.13@tcp:101: 00010000:00010000:3.0:1787365111.350711:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365111.350910:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2788f44a00/0x872d29295eb46cc5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988f32 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.350949:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2788f44a00/0x872d29295eb46cc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f32 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.350961:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2788f44a00/0x872d29295eb46cc5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f32 expref: 9 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365111.350972:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44a00, rc 0) 00000100:00100000:3.0:1787365111.351036:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+9:5599:x1874188003447424:12345-192.168.203.13@tcp:101: Request processed in 345us (469us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365111.351044:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 156 00000020:01000000:1.0:1787365111.351164:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 39-41 (rc=0) 10000000:01000000:1.0:1787365111.351219:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787365111.351230:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb46cb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46cbe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.351239:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb46cb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46cbe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365111.351251:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-MDT0000 10000000:01000000:1.0:1787365111.351254:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 34 10000000:01000000:1.0:1787365111.351257:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:1.0:1787365111.351289:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46ccc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.351298:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46ccc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.351307:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46ccc lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365111.351330:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbbb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024445696:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787365111.351390:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365111.351435:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abfcf780 going to sleep for 11 seconds 00000100:00100000:1.0:1787365111.351459:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024445696 00000100:00100000:1.0:1787365111.351463:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024445696 00000100:00100000:1.0:1787365111.351492:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787365111.351499:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024445696:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787365111.351509:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365111.351519:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a0f87400/0x872d29295eb46cd3 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46ccc expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.351539:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a0f87400/0x872d29295eb46cd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46ccc expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.351548:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a0f87400/0x872d29295eb46cd3 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46ccc expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.351555:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a0f87400, rc 0) 00000100:00100000:1.0:1787365111.351586:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024445696:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 87us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365111.351593:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787365111.351669:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbbb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024445696:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787365111.351684:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46ccc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46cd3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.351695:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46ccc lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46cd3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365111.352396:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbbb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024445824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787365111.352443:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365111.353928:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abfcf780 going to sleep for 11 seconds 00000100:00100000:0.0:1787365111.356191:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024445824 00000100:00100000:0.0:1787365111.356212:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024445824 00000100:00100000:1.0:1787365111.356365:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787365111.356378:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024445824:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787365111.357354:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024445824:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 973us (4904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365111.357366:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00100000:3.0:1787365111.359389:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365111.360299:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003447552 00000100:00100000:0.0:1787365111.360314:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003447552 00000100:00100000:0.0:1787365111.360395:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 159 00000100:00100000:0.0:1787365111.360407:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+9:5599:x1874188003447552:12345-192.168.203.13@tcp:501: 00000100:00100000:0.0:1787365111.360875:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+9:5599:x1874188003447552:12345-192.168.203.13@tcp:501: Request processed in 469us (1500us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365111.360884:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 159 00000100:00100000:2.0:1787365111.362396:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbbb100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024445824:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787365111.362496:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024445952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787365111.362600:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365111.362667:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365111.363149:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024445952 00000100:00100000:1.0:1787365111.363159:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024445952 00000100:00100000:1.0:1787365111.363232:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 160 00000100:00100000:1.0:1787365111.363243:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024445952:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787365111.363511:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024445952:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 269us (910us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365111.363529:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 160 00000100:00100000:2.0:1787365111.363784:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024445952:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787365111.370074:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8452:1874188024446080:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787365111.370204:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365111.370261:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5d900 going to sleep for 11 seconds 00000100:00100000:1.0:1787365111.370360:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024446080 00000100:00100000:1.0:1787365111.370370:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024446080 00000100:00100000:1.0:1787365111.370430:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:1.0:1787365111.370441:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:8452:x1874188024446080:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787365111.371146:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:8452:x1874188024446080:12345-0@lo:502:llog_process_th.0 Request processed in 704us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365111.371157:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787365111.371570:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8452:1874188024446080:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787365111.371610:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787365111.371648:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365111.371651:0:8452:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:2.0:1787365111.371660:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:2.0:1787365111.371697:0:8452:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8452:1874188024446208:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787365111.371746:0:8452:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365111.371789:0:8452:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5d900 going to sleep for 11 seconds 00000100:00100000:3.0:1787365111.372019:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024446208 00000100:00100000:3.0:1787365111.372035:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024446208 00000100:00100000:3.0:1787365111.372085:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:3.0:1787365111.372103:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:8452:x1874188024446208:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787365111.372333:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:8452:x1874188024446208:12345-0@lo:502:llog_process_th.0 Request processed in 240us (587us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365111.372349:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:1.0:1787365111.372437:0:8452:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8452:1874188024446208:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787365111.372461:0:8452:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787365111.372467:0:8452:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365111.372468:0:8452:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787365111.372473:0:8452:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:2.0:1787365111.372590:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 34-36 (rc=0) 10000000:01000000:2.0:1787365111.372611:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:2.0:1787365111.372622:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46ccc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46cd3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.372656:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46ccc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46cd3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365111.372669:0:5832:0:(mgc_request.c:611:do_requeue()) updating log lustre-sptlrpc 10000000:01000000:2.0:1787365111.372672:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f27872bb370 from 1 10000000:01000000:2.0:1787365111.372675:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:2.0:1787365111.372706:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cde00/0x872d29295eb46cda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.372720:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27a12cde00/0x872d29295eb46cda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.372730:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27a12cde00/0x872d29295eb46cda lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365111.372747:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024446336:0@lo:101:ll_cfg_requeue.0 00000100:00100000:2.0:1787365111.372782:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365111.372813:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5d6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365111.373730:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024446336 00000100:00100000:1.0:1787365111.373740:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024446336 00000100:00100000:1.0:1787365111.373799:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:1.0:1787365111.373809:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024446336:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787365111.373891:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365111.373912:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a0f86000/0x872d29295eb46ce1 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46cda expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.373942:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a0f86000/0x872d29295eb46ce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46cda expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.373954:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a0f86000/0x872d29295eb46ce1 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46cda expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.373965:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a0f86000, rc 0) 00000100:00100000:1.0:1787365111.374032:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:5832:x1874188024446336:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 224us (1249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365111.374038:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787365111.374181:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024446336:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787365111.374201:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27a12cde00/0x872d29295eb46cda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ce1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365111.374212:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cde00/0x872d29295eb46cda lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46ce1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365111.374285:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024446464:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787365111.374317:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365111.374356:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5d6c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365111.374427:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024446464 00000100:00100000:3.0:1787365111.374432:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024446464 00000100:00100000:3.0:1787365111.374469:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 164 00000100:00100000:3.0:1787365111.374477:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:5832:x1874188024446464:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365111.374808:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:5832:x1874188024446464:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 331us (489us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787365111.374816:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 164 00000100:00100000:1.0:1787365111.374925:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31ca80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024446464:0@lo:501:ll_cfg_requeue.0 10000000:01000000:1.0:1787365111.374953:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:1.0:1787365111.374961:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cde00/0x872d29295eb46cda lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ce1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.374969:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27a12cde00/0x872d29295eb46cda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ce1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365111.375270:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365111.375326:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003447680 00000100:00100000:1.0:1787365111.375331:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003447680 00000100:00100000:1.0:1787365111.375367:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00100000:1.0:1787365111.375384:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+9:5599:x1874188003447680:12345-192.168.203.13@tcp:503: 00000100:00100000:1.0:1787365111.375593:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+9:5599:x1874188003447680:12345-192.168.203.13@tcp:503: Request processed in 209us (325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365111.375601:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00100000:3.0:1787365111.386170:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365111.386438:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003447808 00000100:00100000:2.0:1787365111.386453:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003447808 00000100:00100000:2.0:1787365111.386524:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 166 00000100:00100000:2.0:1787365111.386537:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+9:6072:x1874188003447808:12345-192.168.203.13@tcp:502: 00000100:00100000:2.0:1787365111.386947:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+9:6072:x1874188003447808:12345-192.168.203.13@tcp:502: Request processed in 411us (790us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365111.386956:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 166 00000100:00100000:0.0:1787365111.401559:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365111.401664:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003447936 00000100:00100000:3.0:1787365111.401678:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003447936 00000100:00100000:3.0:1787365111.401755:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 167 00000100:00100000:3.0:1787365111.401767:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+9:6072:x1874188003447936:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787365111.402151:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+9:6072:x1874188003447936:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 384us (605us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365111.402160:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 167 00000100:00100000:0.0:1787365111.406869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365111.410566:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003448064 00000100:00100000:1.0:1787365111.410589:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003448064 00000100:00100000:1.0:1787365111.410724:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 168 00000100:00100000:1.0:1787365111.410746:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+9:5599:x1874188003448064:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787365111.410769:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365111.410794:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a0f86400/0x872d29295eb46ce8 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988f39 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.410834:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a0f86400/0x872d29295eb46ce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f39 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.410848:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a0f86400/0x872d29295eb46ce8 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f39 expref: 10 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365111.410858:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a0f86400, rc 0) 00000100:00100000:1.0:1787365111.410937:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:5599:x1874188003448064:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 202us (4082us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365111.410945:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 168 00000100:00100000:0.0:1787365111.421126:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365111.421248:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003448192 00000100:00100000:1.0:1787365111.421260:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003448192 00000100:00100000:1.0:1787365111.421330:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00100000:1.0:1787365111.421341:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:5599:x1874188003448192:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787365111.421708:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:5599:x1874188003448192:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 367us (594us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787365111.421725:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00100000:0.0:1787365111.667897:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787365111.667930:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024446592:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787365111.668027:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365111.668677:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024446976:0@lo:400:kworker.0 00000100:00100000:0.0:1787365111.668716:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365111.668925:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874188024446720:0@lo:400:kworker.0 00000100:00100000:1.0:1787365111.668961:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365111.668989:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787365111.668995:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024447104:0@lo:400:kworker.0 00000100:00100000:1.0:1787365111.669019:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365111.669050:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024446720 00000100:00100000:1.0:1787365111.669059:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024446720 00000100:00100000:1.0:1787365111.669122:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024447104 00000100:00100000:1.0:1787365111.669126:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024447104 00000100:00100000:1.0:1787365111.669162:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787365111.669171:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874188024446720:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365111.669233:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbb9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874188024446720:12345-0@lo:400:kworker.0 Request processed in 62us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365111.669240:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787365111.669259:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787365111.669265:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024447104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365111.669292:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbb9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024447104:12345-0@lo:400:kworker.0 Request processed in 28us (273us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365111.669299:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00080000:1.0:1787365111.669319:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365111.669355:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024447104:0@lo:400:kworker.0 00000100:00100000:1.0:1787365111.669367:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874188024446720:0@lo:400:kworker.0 00000100:00100000:0.0:1787365111.669465:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787365111.669472:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024446848:0@lo:400:kworker.0 00000100:00100000:0.0:1787365111.669499:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365111.669854:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024446592 00000100:00100000:2.0:1787365111.669862:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024446592 00000100:00100000:2.0:1787365111.669913:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787365111.669921:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024446592:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787365111.669962:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365111.670010:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024446592:12345-0@lo:13:osp-pre-1-0.0 Request processed in 89us (1984us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365111.670017:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787365111.670035:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024446848 00000100:00100000:2.0:1787365111.670038:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024446848 00000100:00100000:2.0:1787365111.670063:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787365111.670069:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024446848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365111.670119:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024446848:12345-0@lo:400:kworker.0 Request processed in 50us (619us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365111.670125:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787365111.670159:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024446848:0@lo:400:kworker.0 00010000:00080000:2.0:1787365111.670192:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb31d180 x1874188024446592/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365127 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365111.670209:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024446592:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787365111.670349:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787365111.670355:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787365111.675471:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024446976 00000100:00100000:1.0:1787365111.675493:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024446976 00000100:00100000:1.0:1787365111.675617:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787365111.675674:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024446976:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365111.676337:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024446976:12345-0@lo:400:kworker.0 Request processed in 707us (7616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365111.676348:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00010000:00080000:2.0:1787365111.677159:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb3c1c00 x1874188024446976/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365127 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365111.677180:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024446976:0@lo:400:kworker.0 00010000:00010000:1.0:1787365112.178988:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365113.202951:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787365113.575781:0:8490:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fffcc716d40 20000000:00000080:2.0:1787365113.581526:0:8490:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f27bb73f000 uarg=0000000000000000 20000000:01000000:2.0:1787365113.581738:0:8490:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787365113.581746:0:8490:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787365113.581772:0:8490:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787365113.583839:0:8491:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 4 count 4 20000000:02000000:2.0:1787365113.584118:0:8490:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter general.lod.*.mdt_hash=crush in log params 00000040:00080000:2.0:1787365113.589147:0:8490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].4, 224 off8976 00000040:00080000:2.0:1787365113.589215:0:8490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].5, 112 off9088 00000040:00080000:2.0:1787365113.589274:0:8490:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].6, 224 off9312 10000000:01000000:2.0:1787365113.589293:0:8490:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787365113.589318:0:8490:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46cef lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365113.589343:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f278f70b400/0x872d29295eb46a64 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46a5d expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365113.589351:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f278f70ba00/0x872d29295eb46ac6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46abf expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365113.589359:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f27a0f86c00/0x872d29295eb46b91 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46b8a expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365113.589371:0:8490:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f27a0f87200/0x872d29295eb46c4e lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f01 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365113.589379:0:8490:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46cef lrc: 7/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365113.589433:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f27a0f87200/0x872d29295eb46c4e lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f01 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365113.589453:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f27a0f87200/0x872d29295eb46c4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f01 expref: 9 pid: 5828 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365113.589471:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1874188024447232:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365113.589679:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f27a0f86c00/0x872d29295eb46b91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46b8a expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365113.589702:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f27a0f86c00/0x872d29295eb46b91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46b8a expref: 18 pid: 5828 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365113.589712:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1874188024447360:0@lo:104: 00000100:00100000:2.0:1787365113.589762:0:8490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787365113.589880:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f278f70ba00/0x872d29295eb46ac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46abf expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365113.589890:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f278f70ba00/0x872d29295eb46ac6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46abf expref: 18 pid: 5829 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365113.589898:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1874188024447488:0@lo:104: 00000100:00100000:2.0:1787365113.589924:0:8490:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787365113.589948:0:8490:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f278f70b400/0x872d29295eb46a64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46a5d expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365113.589956:0:8490:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f278f70b400/0x872d29295eb46a64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46a5d expref: 18 pid: 5829 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365113.590038:0:8490:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1874188024447616:0@lo:104: 00000100:00100000:2.0:1787365113.590059:0:8490:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5d3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365113.590662:0:5817:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787365113.590689:0:5817:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365113.590705:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024447360 00000100:00100000:3.0:1787365113.590713:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024447360 00000100:00100000:3.0:1787365113.590763:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024447488 00000100:00100000:3.0:1787365113.590767:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024447488 00000100:00100000:3.0:1787365113.590777:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024447616 00000100:00100000:3.0:1787365113.590790:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024447616 00000100:00100000:3.0:1787365113.590827:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787365113.590836:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+5:8490:x1874188024447360:12345-0@lo:104: 00010000:00010000:3.0:1787365113.590853:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc600/0x872d29295eb46b8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46b91 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.590926:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787365113.590932:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+5:8490:x1874188024447360:12345-0@lo:104: Request processed in 97us (1171us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365113.590940:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:3.0:1787365113.591088:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787365113.591100:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bac93850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+4:8490:x1874188024447488:12345-0@lo:104: 00010000:00010000:3.0:1787365113.591109:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46abf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46ac6 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.591145:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787365113.591150:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bac93850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+4:8490:x1874188024447488:12345-0@lo:104: Request processed in 54us (1226us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365113.591156:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:3.0:1787365113.591189:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:3.0:1787365113.591195:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb733480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:8490:x1874188024447616:12345-0@lo:104: 00010000:00010000:3.0:1787365113.591203:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46a5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46a64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.591231:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787365113.591235:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb733480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:8490:x1874188024447616:12345-0@lo:104: Request processed in 41us (547us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365113.591241:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00010000:3.0:1787365113.591273:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:3.0:1787365113.591280:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc600/0x872d29295eb46b8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46b91 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.591289:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cc600 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:3.0:1787365113.591294:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc600/0x872d29295eb46b8a lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46b91 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.591303:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc600/0x872d29295eb46b8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46b91 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787365113.591310:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc600/0x872d29295eb46b8a lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46b91 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365113.591316:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787365113.591352:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc600/0x872d29295eb46b8a lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46b91 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.591359:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787365113.591381:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc600/0x872d29295eb46b8a lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46b91 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.591388:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc600/0x872d29295eb46b8a lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46b91 expref: -99 pid: 7607 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.591403:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787365113.591406:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46abf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46ac6 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.591413:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030400 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:3.0:1787365113.591415:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46abf lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46ac6 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.591430:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46abf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46ac6 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787365113.591555:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46abf lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46ac6 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365113.591563:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787365113.591579:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46abf lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46ac6 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.591585:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787365113.591603:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46abf lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46ac6 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.591610:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46abf lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46ac6 expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.591620:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365113.591648:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46a5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46a64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.591655:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a0f87a00 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:3.0:1787365113.591658:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46a5d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46a64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.591665:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46a5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46a64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787365113.591671:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46a5d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46a64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365113.591683:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:3.0:1787365113.591698:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46a5d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46a64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.591704:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787365113.591711:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46a5d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46a64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.591717:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46a5d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46a64 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.591735:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365113.591738:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365113.591740:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365113.591747:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365113.591770:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024447744:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787365113.592475:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365113.592539:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024447872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787365113.592568:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365113.592587:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787365113.592592:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024448000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787365113.592609:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365113.592673:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024447744 00000100:00100000:3.0:1787365113.592680:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024447744 00010000:00010000:3.0:1787365113.592712:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f27a0f86c00/0x872d29295eb46b91 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46b8a expref: 19 pid: 5828 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365113.592740:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024447872 00000100:00100000:3.0:1787365113.592753:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024447872 00010000:00010000:3.0:1787365113.592766:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f278f70ba00/0x872d29295eb46ac6 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46abf expref: 20 pid: 5829 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365113.592782:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024448000 00000100:00100000:3.0:1787365113.592785:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024448000 00010000:00010000:3.0:1787365113.592794:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f278f70b400/0x872d29295eb46a64 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46a5d expref: 21 pid: 5829 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365113.592945:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31d880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1874188024447360:0@lo:104: 00000100:00100000:2.0:1787365113.592957:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31ce00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1874188024447488:0@lo:104: 00000100:00100000:2.0:1787365113.592976:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1874188024447616:0@lo:104: 00000100:00100000:1.0:1787365113.593200:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787365113.593214:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65f8cd6c-cad4-438a-a88d-c44efaabba70+21:3313:x1874188024447744:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787365113.593233:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365113.593241:0:8434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f27a0f86c00/0x872d29295eb46b91 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46b8a expref: 21 pid: 5828 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365113.593252:0:8434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f27a0f86c00/0x872d29295eb46b91 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46b8a expref: 21 pid: 5828 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365113.593272:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a0f86c00/0x872d29295eb46b91 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46b8a expref: 21 pid: 5828 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365113.593289:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365113.593333:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb731180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65f8cd6c-cad4-438a-a88d-c44efaabba70+20:3313:x1874188024447744:12345-0@lo:103:ldlm_bl.0 Request processed in 123us (860us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365113.593340:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787365113.593360:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787365113.593366:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb730e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024447872:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787365113.593374:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365113.593379:0:8434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f278f70ba00/0x872d29295eb46ac6 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46abf expref: 19 pid: 5829 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365113.593400:0:8434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f278f70ba00/0x872d29295eb46ac6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46abf expref: 19 pid: 5829 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365113.593412:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f278f70ba00/0x872d29295eb46ac6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46abf expref: 19 pid: 5829 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365113.593421:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365113.593499:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb730e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:3310:x1874188024447872:12345-0@lo:103:ldlm_bl.0 Request processed in 132us (930us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365113.593507:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:3.0:1787365113.594527:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787365113.594542:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb733100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:3310:x1874188024448000:12345-0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787365113.594556:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365113.594562:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f278f70b400/0x872d29295eb46a64 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46a5d expref: 17 pid: 5829 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.594573:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f278f70b400/0x872d29295eb46a64 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46a5d expref: 17 pid: 5829 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.594589:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f278f70b400/0x872d29295eb46a64 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46a5d expref: 17 pid: 5829 timeout: 380 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.594603:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365113.594670:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb733100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:3310:x1874188024448000:12345-0@lo:103:ldlm_bl.0 Request processed in 135us (2058us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365113.594677:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:3.0:1787365113.594734:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb732a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024448000:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787365113.594744:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb731f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024447872:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787365113.594775:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb731880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024447744:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787365113.611843:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365113.612027:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003448320 00000100:00100000:3.0:1787365113.612066:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003448320 00010000:00010000:3.0:1787365113.612132:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f27a0f87200/0x872d29295eb46c4e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f01 expref: 10 pid: 5828 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365113.612182:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:3.0:1787365113.612194:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2361:x1874188003448320:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365113.612218:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365113.612225:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f27a0f87200/0x872d29295eb46c4e lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f01 expref: 10 pid: 5828 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.612240:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f27a0f87200/0x872d29295eb46c4e lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f01 expref: 10 pid: 5828 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.612272:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46cef lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.612283:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46cef lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.612302:0:5818:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46cef lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.612310:0:5818:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46cef lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.612317:0:5818:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46cef lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.612324:0:5818:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46cef lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.612331:0:5818:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12ccc00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365113.612341:0:5818:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46cef lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.612351:0:5818:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46cef lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.612362:0:5818:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46cef lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365113.612374:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365113.612452:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c1880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2361:x1874188003448320:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 259us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365113.612461:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00010000:00010000:2.0:1787365113.613399:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a0f87200/0x872d29295eb46c4e lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f01 expref: 9 pid: 5828 timeout: 330 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365113.613456:0:8490:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:8490:1874188024447232:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365113.613503:0:8490:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46cef lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365113.613515:0:8490:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46cef lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365113.613522:0:8490:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46cef lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365113.613529:0:8490:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46cef lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 8490 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365114.226947:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787365114.931201:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787365114.931214:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f27882fe000 from 4 10000000:01000000:1.0:1787365114.931221:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787365114.931291:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46cf6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365114.931305:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46cf6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365114.931319:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46cf6 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365114.931352:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbb8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024448128:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787365114.931470:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365114.931537:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bcfb9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787365114.931825:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024448128 00000100:00100000:3.0:1787365114.931834:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024448128 00000100:00100000:3.0:1787365114.931897:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:3.0:1787365114.931907:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:5832:x1874188024448128:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787365114.931926:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365114.931946:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2788f44800/0x872d29295eb46cfd lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46cf6 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365114.931979:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2788f44800/0x872d29295eb46cfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46cf6 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365114.931993:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2788f44800/0x872d29295eb46cfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46cf6 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365114.932004:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44800, rc 0) 00000100:00100000:3.0:1787365114.932059:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024448128:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 153us (589us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365114.932092:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787365114.932235:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbb8000 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024448128:0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787365114.932254:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46cf6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46cfd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365114.932265:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46cf6 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46cfd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365114.932339:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024448256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787365114.932373:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365114.932418:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5d900 going to sleep for 11 seconds 00000100:00100000:3.0:1787365114.932536:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024448256 00000100:00100000:3.0:1787365114.932542:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024448256 00000100:00100000:3.0:1787365114.932580:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:3.0:1787365114.932587:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024448256:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365114.933151:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024448256:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 561us (773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365114.933160:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:0.0:1787365114.933299:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365114.933850:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003448448 00000100:00100000:2.0:1787365114.933859:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003448448 00000100:00100000:2.0:1787365114.933905:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 172 00000100:00100000:2.0:1787365114.933914:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+9:5599:x1874188003448448:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787365114.933935:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365114.933958:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46d04 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988f40 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365114.933990:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46d04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f40 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365114.934002:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46d04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f40 expref: 10 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365114.934012:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12ccc00, rc 0) 00000100:00100000:2.0:1787365114.934081:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:5599:x1874188003448448:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 168us (785us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365114.934089:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 172 00000100:00100000:1.0:1787365114.936369:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31d180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024448256:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787365114.936904:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024448384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787365114.937008:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365114.937100:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2787828c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787365114.939380:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365114.945097:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024448384 00000100:00100000:1.0:1787365114.945136:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024448384 00000100:00100000:1.0:1787365114.945918:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003448576 00000100:00100000:1.0:1787365114.945928:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003448576 00000100:00100000:0.0:1787365114.947607:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787365114.947658:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024448384:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787365114.948052:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024448384:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 429us (11044us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365114.948062:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 173 00000100:00100000:0.0:1787365114.948126:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 174 00000100:00100000:0.0:1787365114.948136:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:5599:x1874188003448576:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787365114.948390:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:5599:x1874188003448576:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 254us (9023us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365114.948398:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 174 00000100:00100000:1.0:1787365114.951353:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365114.951508:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003448704 00000100:00100000:3.0:1787365114.951521:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003448704 00000100:00100000:3.0:1787365114.951592:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 175 00000100:00100000:3.0:1787365114.951603:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:5599:x1874188003448704:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787365114.951878:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024448384:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787365114.952214:0:8539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8539:1874188024448512:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787365114.952292:0:8539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365114.952326:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024448512 00000100:00100000:0.0:1787365114.952332:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024448512 00000100:00100000:0.0:1787365114.952357:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787365114.952365:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:8539:x1874188024448512:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787365114.953021:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:5599:x1874188003448704:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 1413us (1677us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365114.953033:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 175 00000100:00100000:0.0:1787365114.954125:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:8539:x1874188024448512:12345-0@lo:502:llog_process_th.0 Request processed in 1752us (1825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365114.954138:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787365114.954217:0:8539:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2787828540 going to sleep for 11 seconds 00000100:00100000:0.0:1787365114.954247:0:8539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8539:1874188024448512:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787365114.954285:0:8539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787365114.954306:0:8539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365114.954309:0:8539:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:0.0:1787365114.954319:0:8539:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f27882fe000 00000020:00000080:0.0:1787365114.954322:0:8539:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:0.0:1787365114.956916:0:8539:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8539:1874188024448640:0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787365114.957056:0:8539:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365114.957142:0:8539:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2787828540 going to sleep for 11 seconds 00000100:00100000:3.0:1787365114.957282:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024448640 00000100:00100000:3.0:1787365114.957292:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024448640 00000100:00100000:3.0:1787365114.957355:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:3.0:1787365114.957367:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:8539:x1874188024448640:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787365114.959308:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:8539:x1874188024448640:12345-0@lo:502:llog_process_th.0 Request processed in 1930us (2242us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365114.959324:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787365114.959846:0:8539:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8539:1874188024448640:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787365114.959897:0:8539:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787365114.959907:0:8539:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365114.959910:0:8539:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:0.0:1787365114.959917:0:8539:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:0.0:1787365114.960088:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787365114.960125:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787365114.960141:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46cf6 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46cfd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365114.960155:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46cf6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46cfd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365114.960167:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787365114.960170:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f27a01d6000 from 4 10000000:01000000:0.0:1787365114.960174:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787365114.960218:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46d0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365114.960227:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46d0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365114.960238:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46d0b lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365114.960279:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024448768:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787365114.960339:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365114.960380:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2787828540 going to sleep for 11 seconds 00000100:00100000:0.0:1787365114.960402:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024448768 00000100:00100000:3.0:1787365114.962012:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365114.962304:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024448768 00000100:00100000:0.0:1787365114.962385:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003448832 00000100:00100000:0.0:1787365114.962394:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003448832 00000100:00100000:3.0:1787365114.962575:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 178 00000100:00100000:3.0:1787365114.962591:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024448768:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787365114.962650:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365114.962674:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2788f45c00/0x872d29295eb46d12 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46d0b expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365114.963530:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 179 00000100:00100000:0.0:1787365114.963551:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:6130:x1874188003448832:12345-192.168.203.13@tcp:502:llog_process_th.0 00010000:00010000:3.0:1787365114.963828:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2788f45c00/0x872d29295eb46d12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46d0b expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365114.963845:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2788f45c00/0x872d29295eb46d12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46d0b expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365114.963857:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45c00, rc 0) 00000100:00100000:3.0:1787365114.963959:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024448768:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 1374us (3620us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365114.963967:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 178 00000100:00100000:0.0:1787365114.964928:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:6130:x1874188003448832:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 1378us (2921us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365114.964941:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 179 00000100:00100000:0.0:1787365114.965024:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024448768:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787365114.965052:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46d0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46d12 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365114.965067:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46d0b lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46d12 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365114.965192:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024448896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787365114.965245:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365114.965295:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2787828540 going to sleep for 11 seconds 00000100:00100000:0.0:1787365114.965316:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024448896 00000100:00100000:0.0:1787365114.965322:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024448896 00000100:00100000:0.0:1787365114.965361:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787365114.965370:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024448896:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787365114.965727:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024448896:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 357us (480us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365114.965736:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:0.0:1787365114.965778:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024448896:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787365114.965823:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024449024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787365114.965867:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365114.965882:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2787828540 going to sleep for 11 seconds 00000100:00100000:0.0:1787365114.965895:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024449024 00000100:00100000:0.0:1787365114.965899:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024449024 00000100:00100000:0.0:1787365114.965924:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787365114.965930:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024449024:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787365114.966100:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024449024:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 170us (232us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365114.966107:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00100000:0.0:1787365114.966143:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024449024:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787365114.975296:0:8541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8541:1874188024449152:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787365114.995034:0:8541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365114.995115:0:8541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bb9e30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787365114.995184:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024449152 00000100:00100000:0.0:1787365114.995196:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024449152 00000100:00100000:0.0:1787365114.995258:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:0.0:1787365114.995270:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:8541:x1874188024449152:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787365114.997620:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:8541:x1874188024449152:12345-0@lo:502:llog_process_th.0 Request processed in 2338us (2584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365114.997659:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:3.0:1787365114.998888:0:8541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8541:1874188024449152:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787365114.998946:0:8541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787365114.998958:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365114.998961:0:8541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787365114.998974:0:8541:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f27a01d6000 00000020:00000080:3.0:1787365114.998978:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787365114.999118:0:8541:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8541:1874188024449280:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787365114.999202:0:8541:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365114.999249:0:8541:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bb9e30c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787365114.999376:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024449280 00000100:00100000:0.0:1787365114.999384:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024449280 00000100:00100000:0.0:1787365114.999582:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 183 00000100:00100000:0.0:1787365114.999603:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:8541:x1874188024449280:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787365115.001965:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:8541:x1874188024449280:12345-0@lo:502:llog_process_th.0 Request processed in 2351us (2750us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365115.001984:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 183 00000100:00100000:3.0:1787365115.002708:0:8541:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb731880 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8541:1874188024449280:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787365115.002769:0:8541:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787365115.002780:0:8541:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365115.002782:0:8541:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:3.0:1787365115.003892:0:8541:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000100:00100000:1.0:1787365115.004144:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000020:01000000:0.0:1787365115.004402:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:0.0:1787365115.004546:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787365115.004560:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46d0b lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46d12 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365115.004575:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46d0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46d12 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365115.004588:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787365115.004591:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f2797a7c800 from 4 10000000:01000000:0.0:1787365115.004595:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787365115.006154:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46d19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365115.006175:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46d19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365115.006188:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46d19 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365115.006221:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024449408:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787365115.006311:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365115.006369:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878289c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787365115.006399:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003448960 00000100:00100000:0.0:1787365115.006407:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003448960 00000100:00100000:0.0:1787365115.008877:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024449408 00000100:00100000:0.0:1787365115.008887:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024449408 00000100:00100000:0.0:1787365115.008913:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 184 00000100:00100000:0.0:1787365115.008924:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:6130:x1874188003448960:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787365115.009265:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:6130:x1874188003448960:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 341us (5125us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365115.009275:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 184 00000100:00100000:0.0:1787365115.009307:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787365115.009315:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024449408:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787365115.009325:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365115.009347:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2780030c00/0x872d29295eb46d20 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46d19 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365115.009380:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2780030c00/0x872d29295eb46d20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46d19 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365115.009393:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2780030c00/0x872d29295eb46d20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46d19 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365115.009404:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780030c00, rc 0) 00000100:00100000:0.0:1787365115.015138:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:5832:x1874188024449408:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 5808us (8811us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365115.015157:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787365115.015499:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024449408:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787365115.015533:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46d19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46d20 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365115.015567:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46d19 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46d20 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365115.016481:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024449536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787365115.016554:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365115.016600:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878289c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787365115.016644:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024449536 00000100:00100000:0.0:1787365115.016652:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024449536 00000100:00100000:0.0:1787365115.017125:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787365115.017138:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:5832:x1874188024449536:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787365115.018406:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:5832:x1874188024449536:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 1265us (1846us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365115.019615:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:0.0:1787365115.020581:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024449536:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787365115.021571:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024449664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787365115.021934:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365115.022002:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878289c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787365115.022787:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024449664 00000100:00100000:2.0:1787365115.022799:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024449664 00000100:00100000:2.0:1787365115.022865:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787365115.022875:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:5832:x1874188024449664:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787365115.023165:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:5832:x1874188024449664:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 291us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365115.023174:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:2.0:1787365115.023246:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024449664:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787365115.029127:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbb9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8545:1874188024449792:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787365115.029241:0:8545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365115.029301:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b66d9780 going to sleep for 11 seconds 00000100:00100000:3.0:1787365115.029849:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024449792 00000100:00100000:3.0:1787365115.029859:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024449792 00000100:00100000:3.0:1787365115.029928:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 188 00000100:00100000:3.0:1787365115.029939:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:8545:x1874188024449792:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787365115.030255:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:8545:x1874188024449792:12345-0@lo:502:llog_process_th.0 Request processed in 316us (1014us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365115.030264:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 188 00000100:00100000:1.0:1787365115.030863:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbb9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8545:1874188024449792:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787365115.030916:0:8545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787365115.030930:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365115.030933:0:8545:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787365115.030942:0:8545:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f2797a7c800 00000020:00000080:1.0:1787365115.030945:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787365115.031053:0:8545:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbb9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8545:1874188024449920:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787365115.031131:0:8545:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365115.031176:0:8545:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b66d9780 going to sleep for 11 seconds 00000100:00100000:2.0:1787365115.031248:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024449920 00000100:00100000:2.0:1787365115.031255:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024449920 00000100:00100000:2.0:1787365115.031299:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:2.0:1787365115.031307:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:8545:x1874188024449920:12345-0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787365115.031561:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:8545:x1874188024449920:12345-0@lo:502:llog_process_th.0 Request processed in 253us (430us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365115.031570:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787365115.032550:0:8545:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbb9500 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:8545:1874188024449920:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787365115.032597:0:8545:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787365115.032607:0:8545:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365115.032609:0:8545:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000040:00080000:1.0:1787365115.032614:0:8545:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 00000020:01000000:3.0:1787365115.035352:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 4-6 (rc=0) 10000000:01000000:3.0:1787365115.035394:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787365115.035420:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46d19 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46d20 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365115.035437:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46d19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46d20 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365115.256446:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365115.256681:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365115.256804:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365115.256824:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365115.256853:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003449216 00000100:00100000:3.0:1787365115.256864:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003449216 00000100:00100000:3.0:1787365115.256923:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003449344 00000100:00100000:3.0:1787365115.256925:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003449344 00000100:00100000:3.0:1787365115.256944:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:3.0:1787365115.256955:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2361:x1874188003449216:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365115.257054:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb731880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2361:x1874188003449216:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 101us (380us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365115.257061:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:3.0:1787365115.257090:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:3.0:1787365115.257097:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb732a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2361:x1874188003449344:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365115.257120:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb732a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2361:x1874188003449344:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (295us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365115.257126:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:3.0:1787365115.257143:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003449088 00000100:00100000:3.0:1787365115.257146:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003449088 00000100:00100000:3.0:1787365115.257181:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:3.0:1787365115.257187:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2361:x1874188003449088:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365115.257213:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb731f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2361:x1874188003449088:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 26us (409us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365115.257219:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00080000:3.0:1787365115.257237:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787365115.257241:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787365115.257243:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787365115.765605:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787365115.765663:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024450048:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787365115.765759:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365115.766134:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024450048 00000100:00100000:0.0:1787365115.766145:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024450048 00000100:00100000:0.0:1787365115.766225:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787365115.766235:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024450048:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787365115.766283:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787365115.766342:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbb9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024450048:12345-0@lo:13:osp-pre-0-0.0 Request processed in 108us (583us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365115.766369:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00010000:00080000:1.0:1787365115.766456:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb3c0e00 x1874188024450048/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365131 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365115.766478:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024450048:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787365115.766601:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787365116.275798:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365116.787170:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024450688:0@lo:400:kworker.0 00000100:00100000:1.0:1787365116.787182:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024450304:0@lo:400:kworker.0 00000100:00100000:2.0:1787365116.787238:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024450432:0@lo:400:kworker.0 00000100:00100000:0.0:1787365116.787243:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024450560:0@lo:400:kworker.0 00000100:00100000:3.0:1787365116.790703:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365116.791093:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024450688 00000100:00100000:3.0:1787365116.791105:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024450688 00000100:00100000:3.0:1787365116.791189:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:3.0:1787365116.791202:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024450688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365116.791303:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb731500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024450688:12345-0@lo:400:kworker.0 Request processed in 105us (612us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365116.791312:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:3.0:1787365116.796122:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb3c1f80 x1874188024450688/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365116.796148:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024450688:0@lo:400:kworker.0 00000100:00100000:1.0:1787365116.796674:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365116.796757:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024450176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365116.796807:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365116.796840:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024450816:0@lo:400:kworker.0 00000100:00100000:1.0:1787365116.796869:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365116.797074:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024450176 00000100:00100000:1.0:1787365116.797142:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024450176 00000100:00100000:1.0:1787365116.797222:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787365116.797234:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024450176:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787365116.797284:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365116.797435:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024450176:12345-0@lo:13:osp-pre-1-0.0 Request processed in 202us (625us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365116.797444:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00080000:1.0:1787365116.797518:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787365116.797726:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb31f100 x1874188024450176/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365132 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365116.797749:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024450176:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365116.797804:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024450816 00000100:00100000:1.0:1787365116.797810:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024450816 00000100:00100000:1.0:1787365116.797852:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787365116.797859:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024450816:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365116.797905:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024450304 00000100:00100000:3.0:1787365116.797911:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024450304 00000100:00100000:3.0:1787365116.797961:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:3.0:1787365116.797970:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3313:x1874188024450304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365116.798001:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbba300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024450816:12345-0@lo:400:kworker.0 Request processed in 141us (1129us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365116.798010:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:3.0:1787365116.798019:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3313:x1874188024450304:12345-0@lo:400:kworker.0 Request processed in 50us (1347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365116.798027:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00080000:1.0:1787365116.798068:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365116.798169:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024450304:0@lo:400:kworker.0 00000100:00100000:1.0:1787365116.798182:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024450816:0@lo:400:kworker.0 00000100:00100000:2.0:1787365116.800511:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365116.800571:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024450944:0@lo:400:kworker.0 00000100:00100000:2.0:1787365116.800611:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365116.800702:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024450944 00000100:00100000:2.0:1787365116.800710:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024450944 00000100:00100000:2.0:1787365116.800768:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:2.0:1787365116.803218:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024450944:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365116.803399:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024450944:12345-0@lo:400:kworker.0 Request processed in 2619us (2784us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365116.803414:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00080000:2.0:1787365116.803503:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb3c0e00 x1874188024450944/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365132 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365116.803522:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024450944:0@lo:400:kworker.0 00000100:00100000:1.0:1787365116.804739:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024450432 00000100:00100000:1.0:1787365116.804759:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024450432 00000100:00100000:1.0:1787365116.804851:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787365116.804863:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024450432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365116.804988:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024450432:12345-0@lo:400:kworker.0 Request processed in 126us (4489us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365116.804996:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787365116.805213:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024450432:0@lo:400:kworker.0 00000100:00100000:0.0:1787365116.806296:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365116.806430:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024450560 00000100:00100000:1.0:1787365116.806439:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024450560 00000100:00100000:1.0:1787365116.806572:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787365116.806582:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024450560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365116.806691:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024450560:12345-0@lo:400:kworker.0 Request processed in 111us (401us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365116.806698:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787365116.806768:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024450560:0@lo:400:kworker.0 00000100:00080000:2.0:1787365116.806844:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787365117.303392:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365118.325916:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365119.357103:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365120.371997:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365120.373224:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365120.373263:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365120.373289:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365120.373312:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365120.373335:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003449728 00000100:00100000:1.0:1787365120.373343:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003449728 00000100:00100000:1.0:1787365120.373394:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003449856 00000100:00100000:1.0:1787365120.373397:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003449856 00000100:00100000:1.0:1787365120.373416:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1787365120.373425:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2360:x1874188003449728:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365120.373505:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbbb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2360:x1874188003449728:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 81us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365120.373513:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1787365120.373530:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:1.0:1787365120.373537:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2360:x1874188003449856:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365120.373563:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2360:x1874188003449856:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (251us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365120.373569:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:1.0:1787365120.373587:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003449600 00000100:00100000:1.0:1787365120.373590:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003449600 00000100:00100000:1.0:1787365120.373620:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:1.0:1787365120.373645:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2360:x1874188003449600:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365120.373671:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbbaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2360:x1874188003449600:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 28us (382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365120.373678:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00080000:1.0:1787365120.373696:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787365120.373699:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787365120.373701:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787365120.373828:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003449472 00000100:00100000:2.0:1787365120.373832:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003449472 00000100:00100000:2.0:1787365120.373858:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 191 00000100:00100000:2.0:1787365120.373864:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2360:x1874188003449472:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1787365120.381091:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2360:x1874188003449472:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 7208us (7855us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365120.381121:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 191 00000100:00100000:3.0:1787365120.887616:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024451072:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787365120.889649:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365120.889907:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024451072 00000100:00100000:2.0:1787365120.889916:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024451072 00000100:00100000:2.0:1787365120.889991:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:2.0:1787365120.890000:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024451072:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787365120.890045:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:3.0:1787365120.890211:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787365120.902061:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024451072:12345-0@lo:13:osp-pre-0-0.0 Request processed in 12051us (12409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365120.902085:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00010000:00080000:0.0:1787365120.904062:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb31f480 x1874188024451072/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365136 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365120.904096:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024451072:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787365121.394792:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787365121.903480:0:8789:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing check_logdir /tmp/testlogs/ 00000100:00100000:2.0:1787365121.907830:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024451200:0@lo:400:kworker.0 00000100:00100000:0.0:1787365121.907929:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024451584:0@lo:400:kworker.0 00000100:00100000:2.0:1787365121.907938:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365121.908871:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024451200 00000100:00100000:3.0:1787365121.908879:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024451200 00000100:00100000:3.0:1787365121.908924:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787365121.908933:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024451200:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365121.910609:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024451712:0@lo:400:kworker.0 00000100:00100000:2.0:1787365121.910690:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365121.910725:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787365121.910733:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024451328:0@lo:400:kworker.0 00000100:00100000:2.0:1787365121.910761:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365121.910784:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024451840:0@lo:400:kworker.0 00000100:00100000:2.0:1787365121.910812:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365121.910825:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024451200:12345-0@lo:400:kworker.0 Request processed in 1891us (2886us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365121.910842:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 192 00000100:00100000:3.0:1787365121.910886:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024451456:0@lo:400:kworker.0 00000100:00100000:3.0:1787365121.910914:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365121.911020:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024451712 00000100:00100000:1.0:1787365121.911037:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024451712 00000100:00100000:1.0:1787365121.911083:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024451328 00000100:00100000:1.0:1787365121.911086:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024451328 00000100:00100000:1.0:1787365121.911113:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024451456 00000100:00100000:3.0:1787365121.911117:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787365121.911118:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024451456 00000100:00100000:3.0:1787365121.911130:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024451712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365121.911139:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787365121.911148:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024451328:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365121.911176:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024451712:12345-0@lo:400:kworker.0 Request processed in 48us (485us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365121.911183:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787365121.911201:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787365121.911210:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024451456:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365121.911210:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024451328:12345-0@lo:400:kworker.0 Request processed in 61us (447us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365121.911224:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:3.0:1787365121.911255:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024451456:12345-0@lo:400:kworker.0 Request processed in 47us (339us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365121.911262:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00080000:3.0:1787365121.911279:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365121.911305:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024451456:0@lo:400:kworker.0 00000100:00100000:2.0:1787365121.911764:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024451200:0@lo:400:kworker.0 00000100:00100000:2.0:1787365121.911774:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024451712:0@lo:400:kworker.0 00000100:00100000:2.0:1787365121.911791:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024451328:0@lo:400:kworker.0 00000100:00100000:3.0:1787365121.912248:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024451968:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787365121.912463:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365121.912504:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024451968 00000100:00100000:3.0:1787365121.912509:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024451968 00000100:00100000:3.0:1787365121.912553:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787365121.912561:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024451968:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787365121.912592:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365121.912644:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024451968:12345-0@lo:13:osp-pre-1-0.0 Request processed in 84us (181us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365121.912662:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00080000:3.0:1787365121.912681:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:3.0:1787365121.912706:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bf0f6300 x1874188024451968/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365137 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365121.912722:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024451968:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365121.913546:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024451840 00000100:00100000:1.0:1787365121.913552:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024451840 00000100:00100000:1.0:1787365121.913585:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787365121.913592:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024451840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365121.913659:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024451840:12345-0@lo:400:kworker.0 Request processed in 67us (2846us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365121.913665:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00010000:00080000:2.0:1787365121.917813:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb31c000 x1874188024451840/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365121.917851:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024451840:0@lo:400:kworker.0 00000100:00100000:0.0:1787365121.932246:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365121.932385:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024451584 00000100:00100000:2.0:1787365121.932394:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024451584 00000100:00100000:2.0:1787365121.932447:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787365121.932457:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024451584:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365121.932527:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c0000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024451584:12345-0@lo:400:kworker.0 Request processed in 72us (286us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365121.932534:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00010000:00080000:0.0:1787365121.934695:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb31e300 x1874188024451584/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365137 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365121.934712:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024451584:0@lo:400:kworker.0 00010000:00010000:1.0:1787365122.420826:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365123.443464:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365124.479744:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365125.491164:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365125.505264:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365125.505328:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365125.508207:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003450112 00000100:00100000:0.0:1787365125.508232:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003450112 00000100:00100000:0.0:1787365125.508349:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00080000:1.0:1787365125.508353:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365125.508363:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2362:x1874188003450112:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365125.508487:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbb8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2362:x1874188003450112:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 127us (3236us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365125.508495:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:2.0:1787365125.508609:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003449984 00000100:00100000:2.0:1787365125.508614:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003449984 00000100:00100000:2.0:1787365125.508675:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 193 00000100:00100000:2.0:1787365125.508683:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2362:x1874188003449984:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1787365125.508714:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2362:x1874188003449984:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 32us (3385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365125.508720:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 193 00000100:00100000:1.0:1787365125.522713:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365125.522798:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365125.538167:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003450240 00000100:00100000:2.0:1787365125.538187:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003450240 00000100:00100000:3.0:1787365125.538558:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003450368 00000100:00100000:3.0:1787365125.538564:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003450368 00000100:00100000:3.0:1787365125.538594:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:3.0:1787365125.538606:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2358:x1874188003450240:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:3.0:1787365125.538682:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46c5c 00000100:00080000:3.0:1787365125.538695:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9f27bb320800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787365125.538739:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00010000:00010000:2.0:1787365125.539174:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787365125.539185:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787365125.539190:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787365125.539481:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+2:2358:x1874188003450240:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 872us (16854us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365125.539491:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:3.0:1787365125.539516:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1787365125.539527:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2358:x1874188003450368:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:3.0:1787365125.539546:0:6682:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46c63 00000100:00080000:3.0:1787365125.539554:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9f2685887800 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787365125.539580:0:6682:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:3.0:1787365125.539801:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbb8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+2:2358:x1874188003450368:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 276us (17002us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365125.539809:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00010000:00010000:3.0:1787365125.539883:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365126.002926:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787365126.002954:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024452096:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787365126.003077:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365126.003160:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024452096 00000100:00100000:0.0:1787365126.003170:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024452096 00000100:00100000:0.0:1787365126.003234:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787365126.003245:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024452096:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787365126.003288:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787365126.003339:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024452096:12345-0@lo:13:osp-pre-0-0.0 Request processed in 96us (262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365126.003347:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00080000:0.0:1787365126.003372:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787365126.003405:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb3c1c00 x1874188024452096/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365142 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365126.003422:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024452096:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787365126.515980:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787365126.719641:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8662a6a5-8ae3-4336-8479-3ba18dbc45ca 00000020:00000080:1.0:1787365126.719653:0:6707:0:(genops.c:885:class_export_put()) final put ffff9f27bb325000/8662a6a5-8ae3-4336-8479-3ba18dbc45ca 00000020:00000080:0.0:1787365126.719843:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27bb325000/8662a6a5-8ae3-4336-8479-3ba18dbc45ca for lustre-OST0000 00000020:00000080:0.0:1787365126.719911:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f27bb320800 for lustre-OST0000 00000100:00100000:2.0:1787365127.034904:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024452480:0@lo:400:kworker.0 00000100:00100000:2.0:1787365127.035015:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365127.035091:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024452992:0@lo:400:kworker.0 00000100:00100000:2.0:1787365127.035122:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365127.035169:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787365127.035175:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024452608:0@lo:400:kworker.0 00000100:00100000:2.0:1787365127.035201:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365127.035234:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024452480 00000100:00100000:2.0:1787365127.035242:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024452480 00000100:00100000:2.0:1787365127.035292:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024452608 00000100:00100000:2.0:1787365127.035295:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024452608 00000100:00100000:2.0:1787365127.035332:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787365127.035342:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024452480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365127.035400:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024452480:12345-0@lo:400:kworker.0 Request processed in 58us (385us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365127.035408:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787365127.035433:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787365127.035439:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024452608:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365127.035465:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024452608:12345-0@lo:400:kworker.0 Request processed in 26us (263us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365127.035471:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:2.0:1787365127.035490:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024452992 00000100:00100000:2.0:1787365127.035493:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024452992 00000100:00100000:2.0:1787365127.035523:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787365127.035529:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024452992:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365127.035561:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024452992:12345-0@lo:400:kworker.0 Request processed in 32us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365127.035567:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00080000:2.0:1787365127.035585:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787365127.035591:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365127.035645:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024452608:0@lo:400:kworker.0 00000100:00100000:2.0:1787365127.035673:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024452480:0@lo:400:kworker.0 00010000:00080000:2.0:1787365127.035686:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bf0f7480 x1874188024452992/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365127.035696:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024452992:0@lo:400:kworker.0 00000100:00100000:1.0:1787365127.035872:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024452352:0@lo:400:kworker.0 00000100:00100000:1.0:1787365127.035915:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365127.035952:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024452864:0@lo:400:kworker.0 00000100:00100000:1.0:1787365127.035977:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365127.036009:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787365127.036015:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024452224:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365127.036040:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365127.036060:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024452736:0@lo:400:kworker.0 00000100:00100000:1.0:1787365127.036094:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365127.036127:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024452864 00000100:00100000:1.0:1787365127.036131:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024452864 00000100:00100000:1.0:1787365127.036283:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787365127.036293:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024452864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365127.036337:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbbb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024452864:12345-0@lo:400:kworker.0 Request processed in 46us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365127.036344:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787365127.036368:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024452224 00000100:00100000:1.0:1787365127.036373:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024452224 00000100:00100000:1.0:1787365127.036404:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787365127.036411:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024452224:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787365127.036443:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365127.036477:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbbb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024452224:12345-0@lo:13:osp-pre-1-0.0 Request processed in 67us (436us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365127.036484:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787365127.036501:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024452736 00000100:00100000:1.0:1787365127.036505:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024452736 00000100:00100000:1.0:1787365127.036528:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787365127.036534:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024452736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365127.036564:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbba680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024452736:12345-0@lo:400:kworker.0 Request processed in 30us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365127.036570:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00080000:1.0:1787365127.036584:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787365127.036618:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bf0f7b80 x1874188024452224/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365143 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365127.036661:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024452224:0@lo:13:osp-pre-1-0.0 00010000:00080000:1.0:1787365127.036682:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bf0f4380 x1874188024452736/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365143 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365127.036691:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024452736:0@lo:400:kworker.0 00000100:00100000:1.0:1787365127.036700:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024452864:0@lo:400:kworker.0 00000100:00100000:2.0:1787365127.040037:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024452352 00000100:00100000:2.0:1787365127.040063:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024452352 00000100:00100000:2.0:1787365127.040762:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 194 00000100:00100000:2.0:1787365127.040777:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3313:x1874188024452352:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365127.040912:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3313:x1874188024452352:12345-0@lo:400:kworker.0 Request processed in 139us (4994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365127.040921:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 194 00000100:00100000:1.0:1787365127.052566:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024452352:0@lo:400:kworker.0 00010000:00010000:3.0:1787365127.555019:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365128.563128:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365129.588429:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787365129.764278:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8662a6a5-8ae3-4336-8479-3ba18dbc45ca 00000020:00000080:0.0:1787365129.764292:0:7624:0:(genops.c:885:class_export_put()) final put ffff9f2685883000/8662a6a5-8ae3-4336-8479-3ba18dbc45ca 00000020:00000080:2.0:1787365129.764359:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2685883000/8662a6a5-8ae3-4336-8479-3ba18dbc45ca for lustre-OST0001 00000020:00000080:2.0:1787365129.764432:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f2685887800 for lustre-OST0001 00000001:02000400:2.0:1787365130.015274:0:9034:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing yml_node 00010000:00010000:3.0:1787365130.613107:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365130.616260:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365130.616315:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365130.620728:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003450496 00000100:00100000:0.0:1787365130.620753:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003450496 00000100:00100000:0.0:1787365130.620843:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 195 00000100:00100000:0.0:1787365130.620856:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2360:x1874188003450496:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365130.620960:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2360:x1874188003450496:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 107us (4726us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365130.620980:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 195 00000100:00100000:3.0:1787365130.628216:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003450624 00000100:00100000:3.0:1787365130.628236:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003450624 00000100:00100000:3.0:1787365130.628502:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:3.0:1787365130.628516:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2360:x1874188003450624:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365130.628661:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2360:x1874188003450624:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 145us (12340us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365130.628671:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00080000:2.0:1787365130.628795:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365131.132265:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024453120:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787365131.132361:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365131.132453:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024453120 00000100:00100000:2.0:1787365131.132463:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024453120 00000100:00100000:2.0:1787365131.132529:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:2.0:1787365131.132540:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024453120:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787365131.132588:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365131.132661:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024453120:12345-0@lo:13:osp-pre-0-0.0 Request processed in 122us (299us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365131.132669:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00080000:2.0:1787365131.132715:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787365131.132754:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bf0f7480 x1874188024453120/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365147 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365131.132778:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024453120:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787365131.635908:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365132.147218:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024453504:0@lo:400:kworker.0 00000100:00100000:2.0:1787365132.147312:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365132.147400:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787365132.147407:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024453632:0@lo:400:kworker.0 00000100:00100000:2.0:1787365132.147438:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365132.147486:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024453504 00000100:00100000:2.0:1787365132.147493:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024453504 00000100:00100000:2.0:1787365132.147561:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787365132.147572:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024453504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365132.147668:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024453504:12345-0@lo:400:kworker.0 Request processed in 97us (356us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365132.148981:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787365132.149030:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024453632 00000100:00100000:2.0:1787365132.149038:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024453632 00000100:00100000:2.0:1787365132.149078:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:2.0:1787365132.149086:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024453632:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365132.149153:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024453632:12345-0@lo:400:kworker.0 Request processed in 68us (1713us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365132.149159:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:2.0:1787365132.149177:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365132.149235:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787365132.149247:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024454016:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787365132.149283:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365132.149335:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024454016 00000100:00100000:2.0:1787365132.149339:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024454016 00000100:00100000:2.0:1787365132.149377:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787365132.149382:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024454016:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787365132.149422:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365132.149460:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024454016:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (175us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365132.149466:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00080000:2.0:1787365132.149480:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:2.0:1787365132.149513:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bf0f4380 x1874188024454016/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365148 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365132.149534:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024454016:0@lo:13:osp-pre-1-0.0 00010000:00080000:2.0:1787365132.149567:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bf0f4700 x1874188024453632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365132.149578:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024453632:0@lo:400:kworker.0 00000100:00100000:2.0:1787365132.149591:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024453504:0@lo:400:kworker.0 00000100:00100000:3.0:1787365132.150011:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024453248:0@lo:400:kworker.0 00000100:00100000:3.0:1787365132.150055:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365132.150090:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024453760:0@lo:400:kworker.0 00000100:00100000:3.0:1787365132.150115:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365132.150136:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787365132.150142:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024453376:0@lo:400:kworker.0 00000100:00100000:3.0:1787365132.150165:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365132.150181:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024453888:0@lo:400:kworker.0 00000100:00100000:3.0:1787365132.150202:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365132.150230:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024453760 00000100:00100000:3.0:1787365132.150235:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024453760 00000100:00100000:3.0:1787365132.150274:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024453376 00000100:00100000:3.0:1787365132.150277:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024453376 00000100:00100000:3.0:1787365132.150296:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787365132.150302:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024453760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365132.150356:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024453760:12345-0@lo:400:kworker.0 Request processed in 54us (239us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365132.150364:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787365132.150376:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787365132.150382:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024453376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365132.150422:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024453376:12345-0@lo:400:kworker.0 Request processed in 40us (256us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365132.150428:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787365132.150448:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024453888 00000100:00100000:3.0:1787365132.150452:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024453888 00000100:00100000:3.0:1787365132.150475:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787365132.150481:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024453888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365132.150511:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024453888:12345-0@lo:400:kworker.0 Request processed in 30us (307us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365132.150518:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787365132.150544:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024453376:0@lo:400:kworker.0 00010000:00080000:3.0:1787365132.150556:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bf0f5f80 x1874188024453888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365148 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365132.150564:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024453888:0@lo:400:kworker.0 00000100:00100000:3.0:1787365132.150572:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024453760:0@lo:400:kworker.0 00000100:00080000:3.0:1787365132.150592:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365132.151228:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024453248 00000100:00100000:2.0:1787365132.151234:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024453248 00000100:00100000:2.0:1787365132.151280:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 196 00000100:00100000:2.0:1787365132.151288:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024453248:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365132.151335:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024453248:12345-0@lo:400:kworker.0 Request processed in 48us (1278us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365132.151342:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 196 00000100:00100000:3.0:1787365132.152004:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024453248:0@lo:400:kworker.0 00010000:00010000:3.0:1787365132.659081:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365133.683463:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365134.707116:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365135.730883:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365135.738739:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365135.738810:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365135.738854:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003450752 00000100:00100000:1.0:1787365135.738867:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003450752 00000100:00100000:1.0:1787365135.738942:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 197 00000100:00100000:1.0:1787365135.738954:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2360:x1874188003450752:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365135.739045:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2360:x1874188003450752:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 93us (235us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365135.739054:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 197 00000100:00100000:0.0:1787365135.740790:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003450880 00000100:00100000:0.0:1787365135.740805:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003450880 00000100:00100000:0.0:1787365135.740892:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:0.0:1787365135.740905:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2359:x1874188003450880:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365135.740997:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2359:x1874188003450880:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 96us (2275us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365135.741005:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00080000:1.0:1787365135.741908:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:02000400:3.0:1787365135.827583:0:9226:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Client: 2.17.57.46 00000100:00100000:2.0:1787365136.246276:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024454144:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787365136.246376:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365136.247276:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024454144 00000100:00100000:0.0:1787365136.247287:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024454144 00000100:00100000:0.0:1787365136.247369:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:0.0:1787365136.247382:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024454144:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787365136.247431:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787365136.247504:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024454144:12345-0@lo:13:osp-pre-0-0.0 Request processed in 126us (1128us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365136.247510:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00080000:0.0:1787365136.247556:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb3c1c00 x1874188024454144/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365152 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365136.247575:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024454144:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787365136.248285:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787365136.760081:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365137.267413:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024454528:0@lo:400:kworker.0 00000100:00100000:2.0:1787365137.267510:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365137.267599:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024455040:0@lo:400:kworker.0 00000100:00100000:2.0:1787365137.267651:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365137.267686:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787365137.267692:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024454656:0@lo:400:kworker.0 00000100:00100000:2.0:1787365137.267716:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365137.267752:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024455040 00000100:00100000:2.0:1787365137.267760:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024455040 00000100:00100000:2.0:1787365137.267831:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787365137.267842:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024455040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365137.267901:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024455040:12345-0@lo:400:kworker.0 Request processed in 61us (249us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365137.267909:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787365137.267947:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024454528 00000100:00100000:2.0:1787365137.267950:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024454528 00000100:00100000:2.0:1787365137.267973:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024454656 00000100:00100000:2.0:1787365137.267975:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024454656 00000100:00100000:2.0:1787365137.267994:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787365137.268000:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024454528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365137.268032:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024454528:12345-0@lo:400:kworker.0 Request processed in 32us (522us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365137.268039:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787365137.268050:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:2.0:1787365137.268056:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024454656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365137.268081:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024454656:12345-0@lo:400:kworker.0 Request processed in 26us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365137.268109:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00080000:2.0:1787365137.268128:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787365137.268134:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787365137.268188:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024454656:0@lo:400:kworker.0 00000100:00100000:2.0:1787365137.268200:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024454528:0@lo:400:kworker.0 00010000:00080000:2.0:1787365137.268213:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb31d180 x1874188024455040/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365137.268223:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024455040:0@lo:400:kworker.0 00000100:00100000:1.0:1787365137.268494:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024454400:0@lo:400:kworker.0 00000100:00100000:1.0:1787365137.268536:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365137.268580:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024454912:0@lo:400:kworker.0 00000100:00100000:1.0:1787365137.268604:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365137.268657:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787365137.268674:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024454272:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365137.268702:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365137.268722:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024454784:0@lo:400:kworker.0 00000100:00100000:1.0:1787365137.268745:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365137.268775:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024454400 00000100:00100000:1.0:1787365137.268778:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024454400 00000100:00100000:1.0:1787365137.268811:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787365137.268818:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3313:x1874188024454400:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365137.268856:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3313:x1874188024454400:12345-0@lo:400:kworker.0 Request processed in 38us (319us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365137.268875:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 198 00000100:00100000:1.0:1787365137.268907:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024454784 00000100:00100000:1.0:1787365137.268910:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024454784 00000100:00100000:1.0:1787365137.268942:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787365137.268949:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024454784:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365137.268982:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024454784:12345-0@lo:400:kworker.0 Request processed in 33us (236us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365137.268988:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00010000:00080000:1.0:1787365137.269020:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb31ca80 x1874188024454784/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365153 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365137.269031:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024454784:0@lo:400:kworker.0 00000100:00100000:1.0:1787365137.269040:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024454400:0@lo:400:kworker.0 00000100:00100000:0.0:1787365137.269281:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024454912 00000100:00100000:0.0:1787365137.269287:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024454912 00000100:00100000:0.0:1787365137.269334:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787365137.269342:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024454912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365137.269393:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024454912:12345-0@lo:400:kworker.0 Request processed in 53us (788us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365137.269401:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787365137.269425:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024454272 00000100:00100000:0.0:1787365137.269437:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024454272 00000100:00100000:0.0:1787365137.269464:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787365137.269471:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024454272:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787365137.269505:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787365137.269728:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024454272:12345-0@lo:13:osp-pre-1-0.0 Request processed in 69us (837us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365137.269739:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00080000:0.0:1787365137.269772:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bf0f4700 x1874188024454272/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365153 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365137.269788:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024454272:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787365137.269800:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024454912:0@lo:400:kworker.0 00000100:00080000:1.0:1787365137.270122:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787365137.778843:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365138.802975:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787365139.286022:0:9323:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: MDS: 2.17.57.46 00010000:00010000:0.0:1787365139.839160:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365140.851271:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365140.852136:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365140.852202:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365140.852286:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003451136 00000100:00100000:0.0:1787365140.852294:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003451136 00000100:00100000:0.0:1787365140.852374:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:0.0:1787365140.852384:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2362:x1874188003451136:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365140.852468:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2362:x1874188003451136:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 85us (341us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365140.852476:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00080000:1.0:1787365140.852540:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365140.852595:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003451008 00000100:00100000:2.0:1787365140.852610:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003451008 00000100:00100000:2.0:1787365140.852676:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 199 00000100:00100000:2.0:1787365140.852684:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2362:x1874188003451008:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1787365140.852716:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2362:x1874188003451008:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 33us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365140.852723:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 199 00000100:00100000:0.0:1787365141.367770:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787365141.367793:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024455168:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787365141.367858:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365141.367938:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024455168 00000100:00100000:0.0:1787365141.367945:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024455168 00000100:00100000:0.0:1787365141.368001:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787365141.368020:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024455168:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787365141.368057:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787365141.368114:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024455168:12345-0@lo:13:osp-pre-0-0.0 Request processed in 97us (255us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365141.368121:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00080000:0.0:1787365141.368142:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787365141.368171:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb3c1c00 x1874188024455168/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365157 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365141.368189:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024455168:0@lo:13:osp-pre-0-0.0 00000001:02000400:0.0:1787365141.752190:0:9420:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: OSS: 2.17.57.46 00010000:00010000:0.0:1787365141.876172:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365142.386983:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787365142.387007:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024455296:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787365142.387074:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365142.387227:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024455296 00000100:00100000:2.0:1787365142.387235:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024455296 00000100:00100000:2.0:1787365142.387306:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787365142.387316:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024455296:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787365142.387347:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365142.387391:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024455296:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (317us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365142.387398:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00010000:00080000:2.0:1787365142.387433:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bf0f4000 x1874188024455296/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365158 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365142.387464:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024455296:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787365142.387591:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787365142.388067:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024455680:0@lo:400:kworker.0 00000100:00100000:1.0:1787365142.388102:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365142.388125:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787365142.388131:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024455552:0@lo:400:kworker.0 00000100:00100000:1.0:1787365142.388154:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365142.388181:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024455680 00000100:00100000:1.0:1787365142.388185:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024455680 00000100:00100000:1.0:1787365142.388216:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024455552 00000100:00100000:1.0:1787365142.388219:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024455552 00000100:00100000:1.0:1787365142.388236:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787365142.388254:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024455680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365142.388293:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024455680:12345-0@lo:400:kworker.0 Request processed in 51us (191us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365142.388300:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787365142.388311:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787365142.388317:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024455552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365142.388342:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024455552:12345-0@lo:400:kworker.0 Request processed in 25us (187us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365142.388347:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787365142.388371:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024455552:0@lo:400:kworker.0 00000100:00100000:1.0:1787365142.388380:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024455680:0@lo:400:kworker.0 00000100:00100000:0.0:1787365142.388552:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2788f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024455808:0@lo:400:kworker.0 00000100:00100000:0.0:1787365142.388583:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365142.388618:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787365142.388649:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024455424:0@lo:400:kworker.0 00000100:00100000:0.0:1787365142.388675:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365142.388692:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2788f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024455936:0@lo:400:kworker.0 00000100:00100000:0.0:1787365142.388712:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787365142.388734:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365142.388742:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024455936 00000100:00100000:0.0:1787365142.388746:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024455936 00000100:00100000:0.0:1787365142.388773:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787365142.388779:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024455936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365142.388811:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024455936:12345-0@lo:400:kworker.0 Request processed in 32us (97us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365142.388828:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:0.0:1787365142.388842:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365142.388858:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2788f8ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024455936:0@lo:400:kworker.0 00000100:00100000:3.0:1787365142.388926:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024455808 00000100:00100000:3.0:1787365142.388930:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024455808 00000100:00100000:3.0:1787365142.388965:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:3.0:1787365142.388973:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024455808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365142.389013:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024455808:12345-0@lo:400:kworker.0 Request processed in 41us (429us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365142.389019:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:3.0:1787365142.389046:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2788f8d180 x1874188024455808/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365158 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365142.389057:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2788f8d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024455808:0@lo:400:kworker.0 00000100:00100000:1.0:1787365142.389120:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024455424 00000100:00100000:1.0:1787365142.389124:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024455424 00000100:00100000:1.0:1787365142.389227:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 200 00000100:00100000:1.0:1787365142.389242:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024455424:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365142.389295:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024455424:12345-0@lo:400:kworker.0 Request processed in 55us (619us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365142.389302:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 200 00000100:00100000:0.0:1787365142.389356:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024455424:0@lo:400:kworker.0 00010000:00010000:1.0:1787365142.910866:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:2.0:1787365143.617773:0:9469:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: -----============= acceptance-small: sanity-pcc ============----- Fri Aug 21 22:19:01 EDT 2026 00010000:00010000:0.0:1787365143.922805:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365144.946877:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365145.970944:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365145.971042:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365145.971074:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003451264 00000100:00100000:1.0:1787365145.971083:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003451264 00000100:00100000:1.0:1787365145.971133:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 201 00000100:00100000:1.0:1787365145.971143:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2359:x1874188003451264:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365145.971221:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2359:x1874188003451264:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 79us (179us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365145.971231:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 201 00000100:00100000:0.0:1787365145.975933:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003451392 00000100:00100000:0.0:1787365145.975947:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003451392 00000100:00100000:0.0:1787365145.977014:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:0.0:1787365145.977029:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2359:x1874188003451392:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365145.977106:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2359:x1874188003451392:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 82us (6171us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365145.977114:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00010000:00010000:0.0:1787365145.977278:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787365145.981721:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365146.485403:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024456064:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787365146.485491:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365146.486041:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024456064 00000100:00100000:0.0:1787365146.486049:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024456064 00000100:00100000:0.0:1787365146.486111:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787365146.486121:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024456064:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787365146.486154:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787365146.486213:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024456064:12345-0@lo:13:osp-pre-0-0.0 Request processed in 93us (721us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365146.486221:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:1.0:1787365146.486890:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787365146.486925:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb3c2300 x1874188024456064/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365162 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365146.486945:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024456064:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787365146.996967:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365147.506991:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024456192:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787365147.507359:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874188024456448:0@lo:400:kworker.0 00000100:00100000:1.0:1787365147.507406:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365147.507463:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024456576:0@lo:400:kworker.0 00000100:00100000:0.0:1787365147.507479:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024456320:0@lo:400:kworker.0 00000100:00100000:2.0:1787365147.510560:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365147.510649:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2798099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024456960:0@lo:400:kworker.0 00000100:00100000:2.0:1787365147.510688:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365147.510739:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024456448 00000100:00100000:2.0:1787365147.510745:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024456448 00000100:00100000:2.0:1787365147.510787:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787365147.510795:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874188024456448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365147.510928:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279809b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024456704:0@lo:400:kworker.0 00000100:00100000:1.0:1787365147.510969:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365147.511323:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024456960 00000100:00100000:1.0:1787365147.511328:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024456960 00000100:00100000:1.0:1787365147.511375:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024456704 00000100:00100000:1.0:1787365147.511378:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024456704 00000100:00100000:1.0:1787365147.511392:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787365147.511398:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024456960:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365147.511453:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024456960:12345-0@lo:400:kworker.0 Request processed in 55us (763us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365147.511460:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787365147.511475:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787365147.511481:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024456704:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365147.511511:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024456704:12345-0@lo:400:kworker.0 Request processed in 30us (541us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365147.511517:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787365147.511531:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787365147.511556:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f279809b480 x1874188024456704/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365147.511569:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279809b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024456704:0@lo:400:kworker.0 00000100:00100000:2.0:1787365147.511947:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874188024456448:12345-0@lo:400:kworker.0 Request processed in 1151us (1394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365147.511955:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:2.0:1787365147.511994:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874188024456448:0@lo:400:kworker.0 00010000:00080000:2.0:1787365147.512006:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2798099180 x1874188024456960/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365163 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365147.512015:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2798099180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024456960:0@lo:400:kworker.0 00000100:00100000:3.0:1787365147.512230:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365147.512232:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024456192 00000100:00100000:0.0:1787365147.512239:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024456192 00000100:00100000:0.0:1787365147.512283:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:0.0:1787365147.512300:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024456192:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787365147.512329:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365147.512360:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024456576 00000100:00100000:1.0:1787365147.512365:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024456576 00000100:00100000:0.0:1787365147.512378:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024456192:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (4971us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365147.512386:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787365147.512415:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787365147.512421:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365147.512426:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024456576:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365147.512457:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2798099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024456832:0@lo:400:kworker.0 00000100:00100000:1.0:1787365147.512477:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024456576:12345-0@lo:400:kworker.0 Request processed in 54us (249us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365147.512485:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787365147.512490:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365147.512509:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024456832 00000100:00100000:1.0:1787365147.512513:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024456832 00000100:00100000:1.0:1787365147.512536:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787365147.512542:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024456832:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365147.512573:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024456832:12345-0@lo:400:kworker.0 Request processed in 31us (84us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365147.512579:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:1.0:1787365147.512599:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024456320 00000100:00100000:1.0:1787365147.512602:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024456320 00000100:00100000:1.0:1787365147.512622:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787365147.512647:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024456320:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365147.512679:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2798099880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024456832:0@lo:400:kworker.0 00000100:00100000:1.0:1787365147.512682:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024456320:12345-0@lo:400:kworker.0 Request processed in 37us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365147.512688:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 202 00000100:00100000:1.0:1787365147.512723:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024456576:0@lo:400:kworker.0 00010000:00080000:2.0:1787365147.512792:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bf0f4000 x1874188024456192/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365163 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365147.512860:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024456320:0@lo:400:kworker.0 00000100:00100000:2.0:1787365147.512890:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024456192:0@lo:13:osp-pre-1-0.0 00000100:00080000:3.0:1787365147.513335:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787365148.019347:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365149.050753:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365150.068580:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365151.092992:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365151.102123:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365151.102168:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365151.102199:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003451520 00000100:00100000:1.0:1787365151.102207:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003451520 00000100:00100000:1.0:1787365151.102251:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 203 00000100:00100000:1.0:1787365151.102259:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2362:x1874188003451520:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365151.102323:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2362:x1874188003451520:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 64us (155us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365151.102331:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 203 00000100:00100000:0.0:1787365151.102997:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003451648 00000100:00100000:0.0:1787365151.103004:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003451648 00000100:00100000:0.0:1787365151.103057:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:0.0:1787365151.103065:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2362:x1874188003451648:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365151.103118:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2362:x1874188003451648:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 54us (1003us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365151.103124:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00080000:1.0:1787365151.108179:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365151.604800:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2788f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024457088:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787365151.604890:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365151.605050:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024457088 00000100:00100000:1.0:1787365151.605057:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024457088 00000100:00100000:1.0:1787365151.605117:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:1.0:1787365151.605126:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024457088:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787365151.605159:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365151.605202:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024457088:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365151.605209:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00010000:00080000:1.0:1787365151.605240:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2788f8e300 x1874188024457088/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365167 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365151.605255:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2788f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024457088:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787365151.605308:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787365152.118559:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365152.627806:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2798098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024457216:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787365152.627886:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365152.629102:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874188024457472:0@lo:400:kworker.0 00000100:00100000:2.0:1787365152.629147:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365152.629176:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787365152.629182:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024457344:0@lo:400:kworker.0 00000100:00100000:2.0:1787365152.629205:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365152.629241:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024457472 00000100:00100000:2.0:1787365152.629247:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024457472 00000100:00100000:2.0:1787365152.629289:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787365152.629296:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874188024457472:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365152.629357:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874188024457472:12345-0@lo:400:kworker.0 Request processed in 59us (208us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365152.629373:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787365152.629397:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024457344 00000100:00100000:2.0:1787365152.629400:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024457344 00000100:00100000:2.0:1787365152.629422:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787365152.629428:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3313:x1874188024457344:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365152.629720:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3313:x1874188024457344:12345-0@lo:400:kworker.0 Request processed in 291us (513us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365152.629727:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 204 00000100:00100000:2.0:1787365152.629761:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024457600:0@lo:400:kworker.0 00000100:00100000:2.0:1787365152.629786:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365152.629826:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024457600 00000100:00100000:2.0:1787365152.629830:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024457600 00000100:00100000:2.0:1787365152.629862:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787365152.629869:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024457600:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365152.629915:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798099f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024457600:12345-0@lo:400:kworker.0 Request processed in 47us (128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365152.629922:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:2.0:1787365152.629940:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365152.629970:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024457600:0@lo:400:kworker.0 00000100:00100000:2.0:1787365152.629997:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31ca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024457344:0@lo:400:kworker.0 00000100:00100000:2.0:1787365152.630008:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874188024457472:0@lo:400:kworker.0 00000100:00100000:0.0:1787365152.631514:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024457216 00000100:00100000:0.0:1787365152.631525:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024457216 00000100:00100000:0.0:1787365152.631579:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787365152.631589:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024457216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787365152.631653:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787365152.631716:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024457216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 129us (3830us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365152.631724:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:0.0:1787365152.631751:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024457856:0@lo:400:kworker.0 00000100:00100000:0.0:1787365152.631781:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365152.632080:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024457728:0@lo:400:kworker.0 00000100:00100000:0.0:1787365152.632111:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787365152.632157:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2798098700 x1874188024457216/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365168 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365152.632176:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2798098700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024457216:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787365152.632444:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787365152.632461:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024457856 00000100:00100000:2.0:1787365152.632465:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024457856 00000100:00100000:2.0:1787365152.632502:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787365152.632510:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024457856:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365152.632550:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024457856:12345-0@lo:400:kworker.0 Request processed in 41us (768us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365152.632556:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:2.0:1787365152.632573:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365152.632657:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024457728 00000100:00100000:3.0:1787365152.632662:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024457728 00000100:00100000:3.0:1787365152.632692:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:3.0:1787365152.632699:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024457728:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365152.632737:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024457728:12345-0@lo:400:kworker.0 Request processed in 39us (626us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365152.632744:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787365152.634135:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024457856:0@lo:400:kworker.0 00010000:00080000:0.0:1787365152.634197:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb31f100 x1874188024457728/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365168 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365152.634206:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024457728:0@lo:400:kworker.0 00010000:00010000:1.0:1787365153.139099:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365154.163910:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365155.187479:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365156.210774:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365156.212184:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365156.212233:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365156.212287:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003451904 00000100:00100000:1.0:1787365156.212297:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003451904 00000100:00100000:1.0:1787365156.212360:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:1.0:1787365156.212371:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2359:x1874188003451904:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365156.212440:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2359:x1874188003451904:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 70us (262us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365156.212448:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:3.0:1787365156.212819:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003451776 00000100:00100000:3.0:1787365156.212833:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003451776 00000100:00100000:3.0:1787365156.212875:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 205 00000100:00100000:3.0:1787365156.212883:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2359:x1874188003451776:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365156.212919:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2359:x1874188003451776:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 38us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365156.212926:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 205 00000100:00080000:0.0:1787365156.213196:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365156.722792:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2788f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024457984:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787365156.722858:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365156.722924:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024457984 00000100:00100000:1.0:1787365156.722930:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024457984 00000100:00100000:1.0:1787365156.722975:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787365156.722983:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024457984:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787365156.723017:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365156.723061:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024457984:12345-0@lo:13:osp-pre-0-0.0 Request processed in 78us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365156.723068:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:1.0:1787365156.723087:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787365156.723113:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2788f8e300 x1874188024457984/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365172 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365156.723131:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2788f8e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024457984:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787365157.245683:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365157.748307:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024458368:0@lo:400:kworker.0 00000100:00100000:0.0:1787365157.748371:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365157.748382:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6c44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024458240:0@lo:400:kworker.0 00000100:00100000:1.0:1787365157.748420:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365157.748429:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787365157.748435:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024458752:0@lo:400:kworker.0 00000100:00100000:0.0:1787365157.748435:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024458496:0@lo:400:kworker.0 00000100:00100000:1.0:1787365157.748458:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365157.748486:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024458368 00000100:00100000:0.0:1787365157.748492:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024458368 00000100:00100000:0.0:1787365157.748560:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024458240 00000100:00100000:0.0:1787365157.748563:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024458240 00000100:00100000:0.0:1787365157.748586:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787365157.748595:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024458368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365157.748596:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024458112:0@lo:400:kworker.0 00000100:00100000:3.0:1787365157.748642:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365157.748653:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c44e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024458368:12345-0@lo:400:kworker.0 Request processed in 58us (282us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365157.748659:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:0.0:1787365157.748676:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787365157.748682:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024458240:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365157.748707:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024458240:12345-0@lo:400:kworker.0 Request processed in 26us (287us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365157.748713:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:0.0:1787365157.748730:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024458752 00000100:00100000:0.0:1787365157.748733:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024458752 00000100:00100000:0.0:1787365157.748758:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:0.0:1787365157.748765:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024458752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365157.748805:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024458752:12345-0@lo:400:kworker.0 Request processed in 40us (346us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365157.748811:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00080000:0.0:1787365157.748826:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787365157.748829:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365157.748841:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:1.0:1787365157.755816:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27b6c45180 x1874188024458752/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365157.755836:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024458752:0@lo:400:kworker.0 00000100:00100000:1.0:1787365157.755874:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6c44380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024458240:0@lo:400:kworker.0 00000100:00100000:1.0:1787365157.756822:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024458112 00000100:00100000:1.0:1787365157.756830:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024458112 00000100:00100000:1.0:1787365157.756956:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 206 00000100:00100000:1.0:1787365157.756965:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024458112:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365157.757041:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024458112:12345-0@lo:400:kworker.0 Request processed in 77us (8398us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365157.757048:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 206 00000100:00100000:2.0:1787365157.757180:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024458496 00000100:00100000:2.0:1787365157.757184:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024458496 00000100:00100000:2.0:1787365157.757213:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787365157.757221:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024458496:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365157.757257:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024458496:12345-0@lo:400:kworker.0 Request processed in 38us (8415us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365157.757264:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787365157.757749:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787365157.757763:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279809aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024458880:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365157.757823:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365157.758806:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024458112:0@lo:400:kworker.0 00000100:00100000:3.0:1787365157.758818:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874188024458624:0@lo:400:kworker.0 00000100:00100000:3.0:1787365157.758857:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365157.759658:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024458624 00000100:00100000:1.0:1787365157.759666:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024458624 00000100:00100000:1.0:1787365157.759727:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787365157.759736:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874188024458624:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365157.759798:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874188024458624:12345-0@lo:400:kworker.0 Request processed in 63us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365157.759805:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00080000:3.0:1787365157.761556:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365157.761617:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6c45880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874188024458624:0@lo:400:kworker.0 00000100:00100000:2.0:1787365157.765903:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024458880 00000100:00100000:2.0:1787365157.765918:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024458880 00000100:00100000:2.0:1787365157.765997:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787365157.766007:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024458880:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787365157.766051:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365157.766126:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024458880:12345-0@lo:13:osp-pre-1-0.0 Request processed in 121us (8302us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365157.766133:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00010000:00080000:1.0:1787365157.766260:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f279809aa00 x1874188024458880/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365173 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365157.766278:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279809aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024458880:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787365157.769538:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27b6c47480 x1874188024458496/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365173 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365157.769556:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6c47480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024458496:0@lo:400:kworker.0 00000100:00100000:0.0:1787365157.769591:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6c47100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024458368:0@lo:400:kworker.0 00010000:00010000:0.0:1787365158.258823:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365159.287840:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787365159.986239:0:10099:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: start setup 22:19:17 (1787365157) === 00010000:00010000:0.0:1787365160.309368:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365160.832498:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365160.832582:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003452032 00000100:00100000:1.0:1787365160.832601:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003452032 00000100:00100000:1.0:1787365160.832682:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 207 00000100:00100000:1.0:1787365160.832693:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:8130:x1874188003452032:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787365160.832708:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365160.832726:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a0f87200/0x872d29295eb46d27 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988f47 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365160.832770:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a0f87200/0x872d29295eb46d27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f47 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365160.832781:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a0f87200/0x872d29295eb46d27 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f47 expref: 11 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365160.832789:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a0f87200, rc 0) 00000100:00100000:1.0:1787365160.832847:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+11:8130:x1874188003452032:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 156us (364us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365160.832867:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 207 00000100:00100000:3.0:1787365160.838820:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365160.861071:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003452160 00000100:00100000:1.0:1787365160.861093:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003452160 00000100:00100000:1.0:1787365160.861197:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00100000:1.0:1787365160.861209:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+11:8130:x1874188003452160:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787365160.861686:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+11:8130:x1874188003452160:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 476us (22879us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365160.861697:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00100000:3.0:1787365160.869842:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365160.869956:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003452288 00000100:00100000:2.0:1787365160.869969:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003452288 00000100:00100000:2.0:1787365160.870044:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:2.0:1787365160.870057:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+11:8130:x1874188003452288:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787365160.870608:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+11:8130:x1874188003452288:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 549us (779us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365160.870619:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:0.0:1787365160.882908:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365160.883039:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003452416 00000100:00100000:2.0:1787365160.883054:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003452416 00000100:00100000:2.0:1787365160.883123:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:2.0:1787365160.883136:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+11:8135:x1874188003452416:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787365160.885253:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+11:8135:x1874188003452416:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 2103us (2344us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365160.885270:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:3.0:1787365160.904463:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365160.911451:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003452544 00000100:00100000:2.0:1787365160.911474:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003452544 00000100:00100000:1.0:1787365160.911860:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 211 00000100:00100000:1.0:1787365160.911877:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+11:8135:x1874188003452544:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787365160.912300:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+11:8135:x1874188003452544:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 426us (7850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365160.912313:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 211 00000100:00100000:3.0:1787365160.919434:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365160.919549:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003452672 00000100:00100000:1.0:1787365160.919572:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003452672 00000100:00100000:1.0:1787365160.919683:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 212 00000100:00100000:1.0:1787365160.919695:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+11:8130:x1874188003452672:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:1.0:1787365160.919718:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365160.919744:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a0f86200/0x872d29295eb46d2e lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988f71 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365160.919793:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a0f86200/0x872d29295eb46d2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f71 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365160.919807:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a0f86200/0x872d29295eb46d2e lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f71 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365160.919840:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a0f86200, rc 0) 00000100:00100000:1.0:1787365160.919917:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+12:8130:x1874188003452672:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 224us (498us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365160.919924:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 212 00000100:00100000:0.0:1787365160.932720:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365160.932898:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003452800 00000100:00100000:2.0:1787365160.932911:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003452800 00000100:00100000:1.0:1787365160.933132:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 213 00000100:00100000:1.0:1787365160.933147:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+12:8130:x1874188003452800:12345-192.168.203.13@tcp:256:mount.lustre.0 20000000:01000000:1.0:1787365160.933183:0:5827:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:1.0:1787365160.933217:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:1.0:1787365160.933222:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:1.0:1787365160.933226:0:5827:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:1.0:1787365160.933228:0:5827:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 5 00000100:00100000:1.0:1787365160.935207:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+12:8130:x1874188003452800:12345-192.168.203.13@tcp:256:mount.lustre.0 Request processed in 2044us (2484us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365160.935224:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 213 00000100:00100000:3.0:1787365160.940942:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365160.941229:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003452928 00000100:00100000:2.0:1787365160.941244:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003452928 00000100:00100000:2.0:1787365160.941371:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 214 00000100:00100000:2.0:1787365160.941404:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+12:8130:x1874188003452928:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787365160.941427:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365160.941450:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46d35 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988f78 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365160.941488:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46d35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f78 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365160.941500:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46d35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f78 expref: 13 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365160.941510:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cc600, rc 0) 00000100:00100000:2.0:1787365160.941602:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:8130:x1874188003452928:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 202us (674us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365160.941610:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 214 00000100:00100000:0.0:1787365160.949508:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365160.950701:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003453056 00000100:00100000:1.0:1787365160.950719:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003453056 00000100:00100000:1.0:1787365160.950879:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 215 00000100:00100000:1.0:1787365160.950892:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:8130:x1874188003453056:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:1.0:1787365160.951328:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:8130:x1874188003453056:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 436us (1851us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365160.951336:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 215 00000100:00100000:0.0:1787365160.957934:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365160.958461:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003453184 00000100:00100000:2.0:1787365160.958475:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003453184 00000100:00100000:2.0:1787365160.958552:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 216 00000100:00100000:2.0:1787365160.958564:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:8130:x1874188003453184:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787365160.959240:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:8130:x1874188003453184:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 671us (1410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365160.959251:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 216 00000100:00100000:2.0:1787365160.975603:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365160.975766:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003453312 00000100:00100000:1.0:1787365160.975779:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003453312 00000100:00100000:1.0:1787365160.975854:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 217 00000100:00100000:1.0:1787365160.975866:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:8138:x1874188003453312:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:1.0:1787365160.976206:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:8138:x1874188003453312:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 340us (617us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365160.976215:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 217 00000100:00100000:0.0:1787365160.995784:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365160.996594:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003453440 00000100:00100000:3.0:1787365160.996606:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003453440 00000100:00100000:3.0:1787365160.996702:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 218 00000100:00100000:3.0:1787365160.996713:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:8138:x1874188003453440:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787365160.997004:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:8138:x1874188003453440:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 292us (1228us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365160.997013:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 218 00000100:00100000:0.0:1787365161.014300:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365161.014349:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365161.014466:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003453568 00000100:00100000:1.0:1787365161.014475:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003453568 00000100:00100000:1.0:1787365161.018148:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003453952 00000100:00100000:1.0:1787365161.018157:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003453952 00000100:00100000:1.0:1787365161.018220:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:1.0:1787365161.018230:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2360:x1874188003453952:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365161.018307:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c47480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2360:x1874188003453952:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 78us (3958us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365161.018314:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:1.0:1787365161.018333:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:1.0:1787365161.018338:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1874188003453568:12345-192.168.203.13@tcp:38:mount.lustre.0 00010000:00080000:1.0:1787365161.018360:0:5834:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from c868fdb9-61c7-472a-bd37-21cfd41249aa@192.168.203.13@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:1.0:1787365161.018391:0:5834:0:(genops.c:1385:class_connect()) connect: client c868fdb9-61c7-472a-bd37-21cfd41249aa, cookie 0x872d29295eb46d3c 00000004:00100000:1.0:1787365161.018432:0:5834:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:3.0:1787365161.018883:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787365161.025098:0:5834:0:(import.c:65:import_set_state_nolock()) ffff9f27bb326800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787365161.025278:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c47100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c868fdb9-61c7-472a-bd37-21cfd41249aa+6:2358:x1874188003453568:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 6936us (10985us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365161.025292:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:0.0:1787365161.043843:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365161.043890:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365161.043971:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003453824 00000100:00100000:3.0:1787365161.043980:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003453824 00000100:00100000:3.0:1787365161.044058:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003453696 00000100:00100000:3.0:1787365161.044062:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003453696 00000100:00100000:3.0:1787365161.044084:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1787365161.044094:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+7:8130:x1874188003453824:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787365161.044139:0:6704:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787365161.044215:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c44700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+7:8130:x1874188003453824:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 122us (382us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365161.044222:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1787365161.044239:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1787365161.044245:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+6:0:x1874188003453696:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787365161.044258:0:6704:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787365161.044280:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c44000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+6:0:x1874188003453696:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 34us (389us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365161.044285:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00080000:0.0:1787365161.044345:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365161.046849:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365161.046952:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003454080 00000100:00100000:2.0:1787365161.046961:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003454080 00000100:00100000:2.0:1787365161.047002:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:2.0:1787365161.047010:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c868fdb9-61c7-472a-bd37-21cfd41249aa+6:8130:x1874188003454080:12345-192.168.203.13@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787365161.047106:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c868fdb9-61c7-472a-bd37-21cfd41249aa+6:8130:x1874188003454080:12345-192.168.203.13@tcp:40:mount.lustre.0 Request processed in 95us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365161.047115:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:0.0:1787365161.052907:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365161.052945:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365161.052980:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365161.053076:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003454208 00000100:00100000:1.0:1787365161.053086:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003454208 00000100:00100000:1.0:1787365161.053125:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003454336 00000100:00100000:1.0:1787365161.053129:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003454336 00000100:00100000:1.0:1787365161.053144:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:1.0:1787365161.053165:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1874188003454208:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787365161.053196:0:6682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from c868fdb9-61c7-472a-bd37-21cfd41249aa@192.168.203.13@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:1.0:1787365161.053227:0:6682:0:(genops.c:1385:class_connect()) connect: client c868fdb9-61c7-472a-bd37-21cfd41249aa, cookie 0x872d29295eb46d43 00002000:00100000:1.0:1787365161.053239:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli c868fdb9-61c7-472a-bd37-21cfd41249aa/ffff9f27bb327800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787365161.053261:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787365161.053535:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787365161.053565:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9f27bb325800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787365161.053660:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c868fdb9-61c7-472a-bd37-21cfd41249aa+6:2358:x1874188003454208:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 494us (712us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365161.053669:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:1.0:1787365161.053690:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:1.0:1787365161.053695:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1874188003454336:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:1.0:1787365161.053711:0:6682:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from c868fdb9-61c7-472a-bd37-21cfd41249aa@192.168.203.13@tcp t0 exp 0000000000000000 cur 278 last 0 00000020:00000080:1.0:1787365161.053727:0:6682:0:(genops.c:1385:class_connect()) connect: client c868fdb9-61c7-472a-bd37-21cfd41249aa, cookie 0x872d29295eb46d4a 00002000:00100000:1.0:1787365161.053733:0:6682:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli c868fdb9-61c7-472a-bd37-21cfd41249aa/ffff9f27bb326000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787365161.053747:0:6682:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:1.0:1787365161.055290:0:6682:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:1.0:1787365161.055326:0:6682:0:(import.c:65:import_set_state_nolock()) ffff9f27bb325000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787365161.055381:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c868fdb9-61c7-472a-bd37-21cfd41249aa+6:2358:x1874188003454336:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 1682us (2399us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365161.055391:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1787365161.057673:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003454464 00000100:00100000:3.0:1787365161.057686:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003454464 00000100:00100000:3.0:1787365161.057752:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:3.0:1787365161.057771:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c868fdb9-61c7-472a-bd37-21cfd41249aa+6:8130:x1874188003454464:12345-192.168.203.13@tcp:33:mount.lustre.0 00000004:00200000:2.0:1787365161.063431:0:5836:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787365161.063675:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:c868fdb9-61c7-472a-bd37-21cfd41249aa+6:8130:x1874188003454464:12345-192.168.203.13@tcp:33:mount.lustre.0 Request processed in 5901us (10772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365161.063690:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00010000:00010000:3.0:1787365161.331559:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365161.843073:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2788f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024459008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787365161.843167:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365161.843352:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024459008 00000100:00100000:1.0:1787365161.843360:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024459008 00000100:00100000:1.0:1787365161.843443:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00080000:3.0:1787365161.843457:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787365161.843468:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279809a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024459008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787365161.843503:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365161.843556:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279809a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024459008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (388us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365161.843563:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00010000:00080000:3.0:1787365161.844160:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2788f8dc00 x1874188024459008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365177 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365161.844180:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2788f8dc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024459008:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787365162.356445:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787365162.465661:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c868fdb9-61c7-472a-bd37-21cfd41249aa 00000100:00100000:2.0:1787365162.867009:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024459392:0@lo:400:kworker.0 00000100:00100000:2.0:1787365162.867078:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365162.867125:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024459904:0@lo:400:kworker.0 00000100:00100000:2.0:1787365162.867149:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365162.867178:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787365162.867184:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024459520:0@lo:400:kworker.0 00000100:00100000:2.0:1787365162.867205:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365162.867233:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024459392 00000100:00100000:2.0:1787365162.867239:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024459392 00000100:00100000:2.0:1787365162.867277:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024459520 00000100:00100000:2.0:1787365162.867280:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024459520 00000100:00100000:2.0:1787365162.867309:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787365162.867317:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279809a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024459392:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365162.867376:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279809a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024459392:12345-0@lo:400:kworker.0 Request processed in 59us (298us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365162.867384:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787365162.867409:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787365162.867415:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024459520:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365162.867445:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024459520:12345-0@lo:400:kworker.0 Request processed in 30us (239us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365162.867451:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:2.0:1787365162.867484:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365162.867509:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024459520:0@lo:400:kworker.0 00000100:00100000:2.0:1787365162.867518:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31d180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024459392:0@lo:400:kworker.0 00000100:00100000:0.0:1787365162.868127:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279809b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024459136:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787365162.868163:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365162.868196:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024459648:0@lo:400:kworker.0 00000100:00100000:0.0:1787365162.868218:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365162.868238:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787365162.868244:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024459264:0@lo:400:kworker.0 00000100:00100000:0.0:1787365162.868269:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365162.868288:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874188024459776:0@lo:400:kworker.0 00000100:00100000:0.0:1787365162.868322:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365162.868361:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024459904 00000100:00100000:0.0:1787365162.868366:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024459904 00000100:00100000:0.0:1787365162.868399:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024459648 00000100:00100000:0.0:1787365162.868402:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024459648 00000100:00100000:0.0:1787365162.868415:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787365162.868439:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279809bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024459904:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365162.868489:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279809bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024459904:12345-0@lo:400:kworker.0 Request processed in 51us (1339us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365162.868497:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787365162.868510:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:0.0:1787365162.868516:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024459648:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365162.868546:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c46300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024459648:12345-0@lo:400:kworker.0 Request processed in 30us (327us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365162.868552:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00010000:00080000:0.0:1787365162.868579:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bf0f3800 x1874188024459648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365162.868591:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024459648:0@lo:400:kworker.0 00000100:00100000:2.0:1787365162.868739:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024459136 00000100:00100000:2.0:1787365162.868755:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024459136 00000100:00100000:2.0:1787365162.868782:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787365162.868788:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024459136:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787365162.868814:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365162.868851:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c47800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024459136:12345-0@lo:13:osp-pre-1-0.0 Request processed in 63us (687us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365162.868869:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:2.0:1787365162.868890:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024459264 00000100:00100000:2.0:1787365162.868893:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024459264 00000100:00100000:2.0:1787365162.868919:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 219 00000100:00100000:2.0:1787365162.868926:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024459264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365162.868956:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024459264:12345-0@lo:400:kworker.0 Request processed in 31us (686us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365162.868962:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 219 00000100:00080000:2.0:1787365162.868989:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787365162.868998:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024459776 00000100:00100000:2.0:1787365162.869001:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024459776 00000100:00100000:2.0:1787365162.869036:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787365162.869042:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874188024459776:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365162.869071:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c47b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874188024459776:12345-0@lo:400:kworker.0 Request processed in 29us (749us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365162.869077:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00080000:2.0:1787365162.869093:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787365162.869111:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bf0f3b80 x1874188024459904/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365178 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365162.869122:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024459904:0@lo:400:kworker.0 00000100:00100000:2.0:1787365162.869143:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024459264:0@lo:400:kworker.0 00000100:00100000:2.0:1787365162.869153:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f2300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874188024459776:0@lo:400:kworker.0 00010000:00080000:2.0:1787365162.869162:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f279809b800 x1874188024459136/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365178 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365162.869175:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279809b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024459136:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787365163.381899:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365164.403026:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365165.426896:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787365165.490827:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c868fdb9-61c7-472a-bd37-21cfd41249aa 00000001:00100000:0.0:1787365165.512202:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c868fdb9-61c7-472a-bd37-21cfd41249aa 00000100:00100000:0.0:1787365166.456242:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365166.456288:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365166.456401:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365166.456489:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365166.456542:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003454592 00000100:00100000:3.0:1787365166.456562:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003454592 00000100:00100000:3.0:1787365166.456644:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 220 00000100:00100000:3.0:1787365166.456655:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2359:x1874188003454592:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365166.456743:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2359:x1874188003454592:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 90us (510us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365166.456751:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 220 00000100:00100000:1.0:1787365166.460562:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003455104 00000100:00100000:1.0:1787365166.460575:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003455104 00000100:00100000:1.0:1787365166.460680:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:0.0:1787365166.461170:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365166.461261:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2359:x1874188003455104:12345-192.168.203.13@tcp:400:kworker.0 00000100:00080000:3.0:1787365166.461350:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787365166.461447:0:6682:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787365166.461455:0:6682:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_003' 00000100:00100000:3.0:1787365166.461470:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787365166.461476:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003454976 00000100:00100000:3.0:1787365166.461480:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003454976 00000100:00100000:3.0:1787365166.461504:0:6680:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 3 min 3 max 116 00000100:00100000:3.0:1787365166.461511:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:3.0:1787365166.461519:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2359:x1874188003454976:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365166.461556:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2359:x1874188003454976:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 38us (388us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365166.461563:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00080000:3.0:1787365166.461661:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787365166.462802:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2359:x1874188003455104:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 2106us (6394us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365166.462812:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:2.0:1787365166.468116:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003454848 00000100:00100000:0.0:1787365166.468117:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003454720 00000100:00100000:2.0:1787365166.468132:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003454848 00000100:00100000:0.0:1787365166.468132:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003454720 00000100:00100000:2.0:1787365166.468217:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:2.0:1787365166.468231:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2359:x1874188003454848:12345-192.168.203.13@tcp:400:kworker.0 00000100:00080000:3.0:1787365166.468241:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787365166.468252:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365166.468359:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c45500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2359:x1874188003454848:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 131us (12069us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365166.468367:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:1.0:1787365166.468380:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:1.0:1787365166.468390:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2359:x1874188003454720:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365166.468423:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c45c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2359:x1874188003454720:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 35us (11936us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365166.468430:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00080000:0.0:1787365166.469054:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365166.965340:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787365166.965363:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2788f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024460032:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787365166.965432:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365166.965670:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024460032 00000100:00100000:1.0:1787365166.965678:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024460032 00000100:00100000:1.0:1787365166.965747:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:1.0:1787365166.965756:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024460032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787365166.965790:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365166.965843:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024460032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 87us (409us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365166.965866:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00010000:00080000:3.0:1787365166.965971:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2788f8c380 x1874188024460032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365182 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365166.965989:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2788f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024460032:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787365166.966062:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787365167.482824:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787365167.966232:0:10297:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-client.virtnet: executing check_config_client /mnt/lustre 00000100:00100000:1.0:1787365167.987809:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279809b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024460160:0@lo:400:kworker.0 00000100:00100000:1.0:1787365167.987878:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365167.987998:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024460416:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787365167.988035:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365167.991205:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787365167.991226:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279809ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024460288:0@lo:400:kworker.0 00000100:00100000:1.0:1787365167.991285:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365167.991448:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024460288 00000100:00100000:3.0:1787365167.991456:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024460288 00000100:00100000:3.0:1787365167.991508:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787365167.991508:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2798099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874188024460544:0@lo:400:kworker.0 00000100:00100000:3.0:1787365167.991520:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024460288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365167.991542:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365167.991590:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024460544 00000100:00100000:3.0:1787365167.991592:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024460288:12345-0@lo:400:kworker.0 Request processed in 75us (304us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365167.991595:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024460544 00000100:00100000:3.0:1787365167.991603:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787365167.991655:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787365167.991664:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279809aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874188024460544:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365167.991720:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279809aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874188024460544:12345-0@lo:400:kworker.0 Request processed in 47us (167us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365167.991727:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00080000:2.0:1787365167.991748:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365167.991870:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2798099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874188024460544:0@lo:400:kworker.0 00000100:00100000:1.0:1787365167.991995:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024460160 00000100:00100000:1.0:1787365167.992001:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024460160 00000100:00100000:1.0:1787365167.992027:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787365167.992034:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024460160:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365167.992063:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024460160:12345-0@lo:400:kworker.0 Request processed in 31us (4186us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365167.992069:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 221 00000100:00100000:1.0:1787365167.992093:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279809b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874188024460800:0@lo:400:kworker.0 00000100:00100000:1.0:1787365167.992113:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365167.992139:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787365167.992144:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2798098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024460672:0@lo:400:kworker.0 00000100:00100000:1.0:1787365167.992163:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365167.992186:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024460416 00000100:00100000:1.0:1787365167.992189:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024460416 00000100:00100000:1.0:1787365167.992217:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787365167.992224:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024460416:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787365167.992250:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365167.992289:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024460416:12345-0@lo:13:osp-pre-1-0.0 Request processed in 64us (4253us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365167.992303:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787365167.992322:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024460800 00000100:00100000:1.0:1787365167.992325:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024460800 00000100:00100000:1.0:1787365167.992426:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787365167.992498:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874188024460800:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365167.992536:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874188024460800:12345-0@lo:400:kworker.0 Request processed in 40us (421us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365167.992543:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787365167.992564:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024460672 00000100:00100000:1.0:1787365167.992567:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024460672 00000100:00100000:1.0:1787365167.992589:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787365167.992595:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024460672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365167.992648:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024460672:12345-0@lo:400:kworker.0 Request processed in 29us (459us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365167.992655:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00080000:1.0:1787365167.992670:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787365167.992673:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:1.0:1787365167.992695:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2798098380 x1874188024460672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365183 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365167.992706:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2798098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024460672:0@lo:400:kworker.0 00000100:00100000:1.0:1787365167.992730:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279809b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874188024460800:0@lo:400:kworker.0 00010000:00080000:1.0:1787365167.992761:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bf0f2d80 x1874188024460416/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365183 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365167.992776:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024460416:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365167.992800:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279809ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024460288:0@lo:400:kworker.0 00000100:00100000:1.0:1787365167.992817:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279809b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024460160:0@lo:400:kworker.0 00010000:00010000:0.0:1787365168.498999:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365169.522772:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365170.546894:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365171.570995:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365171.573071:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365171.573126:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365171.573155:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365171.573183:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365171.573211:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365171.573248:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003455744 00000100:00100000:3.0:1787365171.573260:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003455744 00000100:00100000:3.0:1787365171.573344:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003455616 00000100:00100000:3.0:1787365171.573348:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003455616 00000100:00100000:3.0:1787365171.573395:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:3.0:1787365171.573405:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2360:x1874188003455744:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365171.573509:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2360:x1874188003455744:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 105us (351us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365171.573517:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:3.0:1787365171.573536:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:3.0:1787365171.573542:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2360:x1874188003455616:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365171.573567:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2360:x1874188003455616:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365171.573573:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:3.0:1787365171.573592:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003455488 00000100:00100000:3.0:1787365171.573595:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003455488 00000100:00100000:3.0:1787365171.573653:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003455360 00000100:00100000:3.0:1787365171.573657:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003455360 00000100:00100000:3.0:1787365171.573681:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:3.0:1787365171.573701:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2360:x1874188003455488:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365171.573733:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2360:x1874188003455488:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 46us (606us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365171.573740:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:3.0:1787365171.573753:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:3.0:1787365171.573760:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2360:x1874188003455360:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365171.573786:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2360:x1874188003455360:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (602us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365171.573793:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00080000:3.0:1787365171.573815:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787365171.573826:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:3.0:1787365171.573829:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787365171.574060:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003455232 00000100:00100000:0.0:1787365171.574066:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003455232 00000100:00100000:0.0:1787365171.574111:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 222 00000100:00100000:0.0:1787365171.574119:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2360:x1874188003455232:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365171.574161:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2360:x1874188003455232:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 43us (1106us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365171.574169:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 222 00000100:00100000:2.0:1787365172.082996:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2788f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024460928:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787365172.083101:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365172.083251:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024460928 00000100:00100000:3.0:1787365172.083261:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024460928 00000100:00100000:3.0:1787365172.083371:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:3.0:1787365172.083383:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024460928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787365172.083443:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787365172.083541:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787365172.086663:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024460928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 3267us (3545us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365172.086692:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00010000:00080000:2.0:1787365172.088912:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2788f8c380 x1874188024460928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365188 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365172.088953:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2788f8c380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024460928:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787365172.594931:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365173.106859:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024461056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787365173.106941:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365173.107429:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024461056 00000100:00100000:1.0:1787365173.107439:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024461056 00000100:00100000:1.0:1787365173.107498:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787365173.107508:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024461056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787365173.107542:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365173.109981:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024461440:0@lo:400:kworker.0 00000100:00100000:2.0:1787365173.110040:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365173.110095:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024461440 00000100:00100000:2.0:1787365173.110102:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024461440 00000100:00100000:2.0:1787365173.110142:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787365173.110150:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024461440:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365173.110193:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024461440:12345-0@lo:400:kworker.0 Request processed in 44us (152us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365173.110200:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787365173.110237:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024461440:0@lo:400:kworker.0 00000100:00100000:1.0:1787365173.111620:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c44380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024461056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 4107us (4671us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365173.111654:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00080000:1.0:1787365173.111695:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787365173.111700:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787365173.111862:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024461184:0@lo:400:kworker.0 00000100:00100000:2.0:1787365173.111922:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00080000:0.0:1787365173.112148:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bf0f1180 x1874188024461056/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365189 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365173.112168:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f1180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024461056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787365173.112425:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787365173.112433:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024461312:0@lo:400:kworker.0 00000100:00100000:2.0:1787365173.112461:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365173.112492:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024461312 00000100:00100000:2.0:1787365173.112497:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024461312 00000100:00100000:2.0:1787365173.112531:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787365173.112538:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279809b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024461312:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365173.112582:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279809b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024461312:12345-0@lo:400:kworker.0 Request processed in 45us (121us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365173.112588:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:2.0:1787365173.112646:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024461312:0@lo:400:kworker.0 00000100:00100000:1.0:1787365173.113161:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024461184 00000100:00100000:1.0:1787365173.113165:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024461184 00000100:00100000:1.0:1787365173.113199:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 223 00000100:00100000:1.0:1787365173.113206:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024461184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365173.113243:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024461184:12345-0@lo:400:kworker.0 Request processed in 38us (1320us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365173.113249:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 223 00000100:00100000:2.0:1787365173.113430:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024461184:0@lo:400:kworker.0 00000100:00100000:3.0:1787365173.114361:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787365173.114374:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874188024461696:0@lo:400:kworker.0 00000100:00100000:2.0:1787365173.114530:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787365173.114541:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024461568:0@lo:400:kworker.0 00000100:00100000:2.0:1787365173.114984:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365173.117961:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365173.118023:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024461696 00000100:00100000:3.0:1787365173.118031:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024461696 00000100:00100000:3.0:1787365173.118084:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:3.0:1787365173.118092:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874188024461696:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365173.118156:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874188024461696:12345-0@lo:400:kworker.0 Request processed in 64us (200us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365173.118163:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00080000:3.0:1787365173.118182:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365173.118211:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f1f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874188024461696:0@lo:400:kworker.0 00000100:00100000:1.0:1787365173.122810:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024461568 00000100:00100000:1.0:1787365173.122822:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024461568 00000100:00100000:1.0:1787365173.123054:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787365173.123064:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024461568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365173.123160:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024461568:12345-0@lo:400:kworker.0 Request processed in 97us (8175us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365173.123167:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00010000:00080000:0.0:1787365173.123391:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bf0f0000 x1874188024461568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365189 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365173.123415:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024461568:0@lo:400:kworker.0 00010000:00010000:3.0:1787365173.618986:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365174.644394:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365175.673653:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365176.692812:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365176.692856:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365176.692891:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003456000 00000100:00100000:3.0:1787365176.692913:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003456000 00000100:00100000:3.0:1787365176.692971:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:3.0:1787365176.692982:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2359:x1874188003456000:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365176.693069:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2359:x1874188003456000:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 89us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365176.693076:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00080000:3.0:1787365176.693098:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365176.693319:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003455872 00000100:00100000:1.0:1787365176.693356:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003455872 00000100:00100000:1.0:1787365176.693425:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 224 00000100:00100000:1.0:1787365176.693435:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2359:x1874188003455872:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365176.693510:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2359:x1874188003455872:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 77us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365176.693519:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 224 00010000:00010000:1.0:1787365176.697904:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365176.700782:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365176.700993:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003456128 00000100:00100000:2.0:1787365176.701016:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003456128 00000100:00100000:2.0:1787365176.701111:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:2.0:1787365176.701124:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2360:x1874188003456128:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1787365176.701214:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2360:x1874188003456128:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 93us (444us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365176.701222:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00080000:3.0:1787365176.701368:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365176.708475:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365176.708523:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365176.708712:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003456256 00000100:00100000:2.0:1787365176.708726:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003456256 00000100:00100000:2.0:1787365176.708810:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003456384 00000100:00100000:2.0:1787365176.708813:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003456384 00000100:00100000:2.0:1787365176.708863:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:2.0:1787365176.708874:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2360:x1874188003456256:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1787365176.708973:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2360:x1874188003456256:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 101us (514us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365176.708982:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:2.0:1787365176.709002:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:2.0:1787365176.709009:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2360:x1874188003456384:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1787365176.709034:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2360:x1874188003456384:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 26us (511us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365176.709041:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00080000:1.0:1787365176.709496:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787365176.709501:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787365177.202976:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787365177.203007:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2788f8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024461824:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787365177.203104:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365177.203176:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024461824 00000100:00100000:3.0:1787365177.203185:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024461824 00000100:00080000:1.0:1787365177.203266:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787365177.203270:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:3.0:1787365177.203290:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024461824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787365177.203542:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365177.203605:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024461824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 325us (500us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365177.203613:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00010000:00080000:2.0:1787365177.204431:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2788f8d880 x1874188024461824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365193 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365177.204460:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2788f8d880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024461824:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787365177.716086:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365178.228157:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024461952:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787365178.228257:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365178.228772:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024461952 00000100:00100000:3.0:1787365178.228783:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024461952 00000100:00100000:3.0:1787365178.228870:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787365178.228883:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024461952:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787365178.228930:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365178.228990:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024461952:12345-0@lo:13:osp-pre-1-0.0 Request processed in 110us (732us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365178.228999:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00080000:0.0:1787365178.229517:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bf0f0000 x1874188024461952/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365194 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365178.229542:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f0000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024461952:0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787365178.229780:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787365178.230252:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279809ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024462336:0@lo:400:kworker.0 00000100:00100000:2.0:1787365178.230306:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365178.230350:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787365178.230356:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279809b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024462208:0@lo:400:kworker.0 00000100:00100000:2.0:1787365178.230380:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365178.230413:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024462336 00000100:00100000:2.0:1787365178.230419:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024462336 00000100:00100000:2.0:1787365178.230472:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024462208 00000100:00100000:2.0:1787365178.230476:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024462208 00000100:00100000:1.0:1787365178.230481:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279809bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024462080:0@lo:400:kworker.0 00000100:00100000:2.0:1787365178.230520:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787365178.230521:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365178.230527:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024462336:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365178.230549:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2798098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024462592:0@lo:400:kworker.0 00000100:00100000:2.0:1787365178.230577:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024462336:12345-0@lo:400:kworker.0 Request processed in 50us (270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365178.230584:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365178.230585:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787365178.230597:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787365178.230602:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024462592 00000100:00100000:1.0:1787365178.230602:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279809b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024462464:0@lo:400:kworker.0 00000100:00100000:2.0:1787365178.230604:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024462592 00000100:00100000:2.0:1787365178.230619:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787365178.230662:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024462208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365178.230667:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365178.230691:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024462208:12345-0@lo:400:kworker.0 Request processed in 67us (310us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365178.230698:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00100000:2.0:1787365178.230711:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787365178.230717:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024462592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365178.230744:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024462592:12345-0@lo:400:kworker.0 Request processed in 27us (158us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365178.230750:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:2.0:1787365178.230782:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024462080 00000100:00100000:2.0:1787365178.230786:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024462080 00000100:00100000:2.0:1787365178.230812:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787365178.230819:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3313:x1874188024462080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365178.230850:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3313:x1874188024462080:12345-0@lo:400:kworker.0 Request processed in 31us (328us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365178.230856:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 225 00000100:00100000:2.0:1787365178.230884:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024462464 00000100:00100000:2.0:1787365178.230887:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024462464 00000100:00080000:0.0:1787365178.230893:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365178.230912:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787365178.230926:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024462464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365178.230959:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024462464:12345-0@lo:400:kworker.0 Request processed in 35us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365178.230965:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787365178.231007:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279809b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024462208:0@lo:400:kworker.0 00000100:00100000:2.0:1787365178.231019:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279809ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024462336:0@lo:400:kworker.0 00010000:00080000:0.0:1787365178.232326:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f279809b100 x1874188024462464/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365194 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365178.232350:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279809b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024462464:0@lo:400:kworker.0 00000100:00100000:0.0:1787365178.232364:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279809bb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024462080:0@lo:400:kworker.0 00000100:00100000:0.0:1787365178.232378:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2798098380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024462592:0@lo:400:kworker.0 00010000:00010000:1.0:1787365178.739882:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365179.766321:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365180.793224:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365181.822857:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365181.822904:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365181.822935:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365181.822978:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365181.823273:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003456896 00000100:00100000:1.0:1787365181.823299:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003456896 00000100:00100000:1.0:1787365181.823387:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1787365181.823400:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2358:x1874188003456896:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:1.0:1787365181.823440:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46d43 00000100:00080000:1.0:1787365181.823453:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9f27bb325800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787365181.823501:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:1.0:1787365181.823970:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:c868fdb9-61c7-472a-bd37-21cfd41249aa+2:2358:x1874188003456896:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 569us (1123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365181.823979:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1787365181.824013:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003456512 00000100:00100000:1.0:1787365181.824018:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003456512 00000100:00100000:1.0:1787365181.824050:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 226 00000100:00100000:1.0:1787365181.824057:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2362:x1874188003456512:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365181.824087:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2362:x1874188003456512:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 31us (1183us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365181.824093:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 226 00000100:00100000:1.0:1787365181.824128:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003456768 00000100:00100000:1.0:1787365181.824131:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003456768 00000100:00100000:1.0:1787365181.824162:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003456640 00000100:00100000:1.0:1787365181.824164:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003456640 00000100:00100000:1.0:1787365181.824188:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:1.0:1787365181.824194:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2362:x1874188003456768:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365181.824229:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2362:x1874188003456768:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 35us (1294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365181.824236:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:1.0:1787365181.824249:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:1.0:1787365181.824255:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2362:x1874188003456640:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365181.824291:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2362:x1874188003456640:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 37us (1314us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365181.824298:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00080000:1.0:1787365181.824322:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787365181.824328:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787365181.824342:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365181.831725:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365181.851035:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365181.851280:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003457024 00000100:00100000:0.0:1787365181.851293:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003457024 00000100:00100000:0.0:1787365181.851393:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:0.0:1787365181.851408:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2358:x1874188003457024:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:0.0:1787365181.851448:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46d4a 00000100:00080000:0.0:1787365181.851460:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9f27bb325000 : changing import state from FULL to CLOSED 00000001:00000004:0.0:1787365181.851512:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967298 00000100:00100000:0.0:1787365181.851976:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:c868fdb9-61c7-472a-bd37-21cfd41249aa+2:2358:x1874188003457024:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 571us (954us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365181.851986:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00010000:00010000:1.0:1787365181.852150:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787365181.852162:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787365182.323656:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787365182.323692:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024462720:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787365182.323812:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365182.323950:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024462720 00000100:00100000:1.0:1787365182.323960:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024462720 00000100:00100000:1.0:1787365182.324034:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787365182.324046:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024462720:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787365182.324095:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365182.324155:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024462720:12345-0@lo:13:osp-pre-0-0.0 Request processed in 110us (342us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365182.324164:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00080000:0.0:1787365182.324224:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:0.0:1787365182.324288:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2787323480 x1874188024462720/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365198 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365182.324313:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787323480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024462720:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787365182.836812:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:3.0:1787365182.959838:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of c868fdb9-61c7-472a-bd37-21cfd41249aa 00000020:00000080:3.0:1787365182.959866:0:6707:0:(genops.c:885:class_export_put()) final put ffff9f27bb327800/c868fdb9-61c7-472a-bd37-21cfd41249aa 00000020:00000080:0.0:1787365182.960155:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27bb327800/c868fdb9-61c7-472a-bd37-21cfd41249aa for lustre-OST0000 00000020:00000080:0.0:1787365182.960224:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f27bb325800 for lustre-OST0000 00000100:00100000:0.0:1787365183.347442:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024462848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365183.347757:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024463232:0@lo:400:kworker.0 00000100:00100000:1.0:1787365183.347811:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365183.347889:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024462976:0@lo:400:kworker.0 00000100:00100000:1.0:1787365183.347898:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787365183.347907:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787320a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024463360:0@lo:400:kworker.0 00000100:00100000:2.0:1787365183.347943:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365183.347951:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365183.347981:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024463488:0@lo:400:kworker.0 00000100:00100000:1.0:1787365183.347998:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024463232 00000100:00100000:1.0:1787365183.348008:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024463232 00000100:00100000:2.0:1787365183.348013:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365183.348042:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787365183.348047:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024463104:0@lo:400:kworker.0 00000100:00100000:2.0:1787365183.348071:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365183.348222:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365183.348314:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024462848 00000100:00100000:3.0:1787365183.348319:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024462848 00000100:00100000:3.0:1787365183.348370:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:3.0:1787365183.348383:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024462848:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787365183.348428:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365183.348487:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024463616:0@lo:400:kworker.0 00000100:00100000:3.0:1787365183.348497:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c46a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024462848:12345-0@lo:13:osp-pre-1-0.0 Request processed in 116us (273us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365183.348506:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:2.0:1787365183.348517:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365183.348550:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024462976 00000100:00100000:2.0:1787365183.348554:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024462976 00000100:00100000:2.0:1787365183.348581:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787365183.348586:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024462976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365183.348965:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024462976:12345-0@lo:400:kworker.0 Request processed in 375us (1020us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365183.348974:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 227 00000100:00100000:2.0:1787365183.349034:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787321880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024462976:0@lo:400:kworker.0 00010000:00080000:2.0:1787365183.350022:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bf0f1880 x1874188024462848/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365199 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365183.350077:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024462848:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365183.354287:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024463488 00000100:00100000:1.0:1787365183.354311:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024463488 00000100:00100000:1.0:1787365183.354404:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024463104 00000100:00100000:1.0:1787365183.354425:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024463104 00000100:00100000:1.0:1787365183.354450:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787365183.354462:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024463232:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365183.354603:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787323480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024463232:12345-0@lo:400:kworker.0 Request processed in 143us (6791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365183.354623:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:1.0:1787365183.354707:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787322300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024463232:0@lo:400:kworker.0 00000100:00100000:1.0:1787365183.354744:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024463360 00000100:00100000:1.0:1787365183.354749:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024463360 00000100:00100000:1.0:1787365183.354784:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024463616 00000100:00100000:1.0:1787365183.354787:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024463616 00000100:00100000:1.0:1787365183.354809:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787365183.354815:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024463360:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365183.354858:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b55500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024463360:12345-0@lo:400:kworker.0 Request processed in 42us (6908us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365183.354864:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787365183.354876:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787365183.354883:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024463616:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365183.354921:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024463616:12345-0@lo:400:kworker.0 Request processed in 40us (6406us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365183.354927:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00080000:1.0:1787365183.354968:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2787320a80 x1874188024463360/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365183.354981:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787320a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024463360:0@lo:400:kworker.0 00010000:00080000:1.0:1787365183.355012:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2787321180 x1874188024463616/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365199 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365183.355039:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787321180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024463616:0@lo:400:kworker.0 00000100:00100000:1.0:1787365183.355066:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787365183.355072:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024463488:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365183.355108:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024463488:12345-0@lo:400:kworker.0 Request processed in 37us (7098us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365183.355114:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:1.0:1787365183.355137:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787321c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024463488:0@lo:400:kworker.0 00000100:00100000:1.0:1787365183.355154:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787365183.355160:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024463104:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365183.355192:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024463104:12345-0@lo:400:kworker.0 Request processed in 33us (7121us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365183.355198:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 89 00000100:00100000:1.0:1787365183.355221:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787323100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024463104:0@lo:400:kworker.0 00000100:00080000:2.0:1787365183.358033:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787365183.358240:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787365183.859834:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365184.884196:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365185.913866:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:0.0:1787365185.947357:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of c868fdb9-61c7-472a-bd37-21cfd41249aa 00000020:00000080:0.0:1787365185.947366:0:7624:0:(genops.c:885:class_export_put()) final put ffff9f27bb326000/c868fdb9-61c7-472a-bd37-21cfd41249aa 00000020:00000080:2.0:1787365185.947470:0:37:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27bb326000/c868fdb9-61c7-472a-bd37-21cfd41249aa for lustre-OST0001 00000020:00000080:2.0:1787365185.947522:0:37:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f27bb325000 for lustre-OST0001 00000100:00100000:1.0:1787365186.931716:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365186.931770:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365186.931840:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003457152 00000100:00100000:0.0:1787365186.931850:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003457152 00000100:00100000:0.0:1787365186.931905:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 228 00000100:00100000:0.0:1787365186.931914:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2362:x1874188003457152:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365186.931986:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2362:x1874188003457152:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 73us (215us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365186.931993:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 228 00000100:00100000:2.0:1787365186.932217:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003457280 00000100:00100000:2.0:1787365186.932221:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003457280 00000100:00100000:2.0:1787365186.932275:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:2.0:1787365186.932284:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2362:x1874188003457280:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1787365186.932322:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b56a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2362:x1874188003457280:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 39us (613us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365186.932329:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00080000:0.0:1787365186.932446:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787365186.932620:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365186.944058:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365186.944238:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003457408 00000100:00100000:3.0:1787365186.944248:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003457408 00000100:00100000:3.0:1787365186.946750:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:3.0:1787365186.946765:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2362:x1874188003457408:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365186.946850:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b54700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2362:x1874188003457408:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 89us (2801us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365186.946858:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00080000:0.0:1787365186.954061:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365187.444315:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787365187.444337:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024463744:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787365187.444401:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365187.445041:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024463744 00000100:00100000:1.0:1787365187.445050:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024463744 00000100:00100000:1.0:1787365187.445126:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:1.0:1787365187.445136:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024463744:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787365187.445170:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365187.445226:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c46680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024463744:12345-0@lo:13:osp-pre-0-0.0 Request processed in 92us (824us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365187.445245:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00010000:00080000:1.0:1787365187.445284:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2786b54380 x1874188024463744/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365203 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365187.445304:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024463744:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787365187.445438:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787365187.962122:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365188.467893:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024464000:0@lo:400:kworker.0 00000100:00100000:1.0:1787365188.467970:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365188.468027:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024464512:0@lo:400:kworker.0 00000100:00100000:1.0:1787365188.468053:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365188.468083:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787365188.468090:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024464128:0@lo:400:kworker.0 00000100:00100000:1.0:1787365188.468114:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365188.468148:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024464000 00000100:00100000:1.0:1787365188.468154:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024464000 00000100:00100000:1.0:1787365188.468197:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024464128 00000100:00100000:1.0:1787365188.468200:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024464128 00000100:00100000:1.0:1787365188.468228:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787365188.468238:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024464000:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365188.468287:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb731880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024464000:12345-0@lo:400:kworker.0 Request processed in 50us (317us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365188.468483:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024463872:0@lo:400:kworker.0 00000100:00100000:0.0:1787365188.468527:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365188.468551:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874188024464384:0@lo:400:kworker.0 00000100:00100000:0.0:1787365188.468583:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365188.468597:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787365188.468602:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024464256:0@lo:400:kworker.0 00000100:00100000:0.0:1787365188.468656:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:0.0:1787365188.468682:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365188.468695:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024464512 00000100:00100000:0.0:1787365188.468698:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024464512 00000100:00100000:0.0:1787365188.468731:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024464256 00000100:00100000:0.0:1787365188.468735:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024464256 00000100:00100000:0.0:1787365188.468756:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787365188.468763:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb732a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024464512:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365188.468815:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb732a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024464512:12345-0@lo:400:kworker.0 Request processed in 52us (761us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365188.468821:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:0.0:1787365188.468838:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787365188.468845:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024464256:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365188.468884:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c45880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024464256:12345-0@lo:400:kworker.0 Request processed in 40us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365188.468890:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:0.0:1787365188.468924:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00080000:0.0:1787365188.468947:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb730380 x1874188024464256/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365188.468960:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024464256:0@lo:400:kworker.0 00000100:00100000:0.0:1787365188.468994:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024464384 00000100:00100000:0.0:1787365188.469004:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024464384 00000100:00100000:0.0:1787365188.469031:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787365188.469047:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024464128:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365188.469077:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb731500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024464128:12345-0@lo:400:kworker.0 Request processed in 31us (963us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365188.469084:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 93 00000100:00100000:0.0:1787365188.469105:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 94 00000100:00100000:0.0:1787365188.469111:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874188024464384:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365188.469142:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c46300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874188024464384:12345-0@lo:400:kworker.0 Request processed in 31us (570us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365188.469148:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 94 00000100:00080000:0.0:1787365188.469167:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365188.469183:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874188024464384:0@lo:400:kworker.0 00000100:00100000:0.0:1787365188.469218:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb731c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024464128:0@lo:400:kworker.0 00000100:00100000:0.0:1787365188.469228:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb732680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024464000:0@lo:400:kworker.0 00010000:00080000:0.0:1787365188.469237:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb730a80 x1874188024464512/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365204 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365188.469244:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024464512:0@lo:400:kworker.0 00000100:00100000:0.0:1787365188.469270:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024463872 00000100:00100000:0.0:1787365188.469274:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024463872 00000100:00100000:0.0:1787365188.469376:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787365188.469385:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3311:x1874188024463872:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365188.469423:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3311:x1874188024463872:12345-0@lo:400:kworker.0 Request processed in 40us (895us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365188.469438:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 229 00000100:00100000:0.0:1787365188.469472:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024463872:0@lo:400:kworker.0 00000100:00100000:1.0:1787365188.469974:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00100000:1.0:1787365188.472470:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024464640:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365188.472540:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365188.472650:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024464640 00000100:00100000:3.0:1787365188.472658:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024464640 00000100:00100000:3.0:1787365188.472711:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:3.0:1787365188.472720:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024464640:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787365188.472752:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365188.472802:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb730a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024464640:12345-0@lo:13:osp-pre-1-0.0 Request processed in 82us (262us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365188.472809:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00010000:00080000:1.0:1787365188.473409:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bf0f0e00 x1874188024464640/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365204 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365188.473429:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024464640:0@lo:13:osp-pre-1-0.0 00010000:00010000:3.0:1787365188.982038:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365190.004482:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787365190.174124:0:10999:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:3.0:1787365191.028919:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365192.050809:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365192.054211:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365192.054244:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365192.054285:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365192.054428:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003457536 00000100:00100000:3.0:1787365192.054437:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003457536 00000100:00100000:3.0:1787365192.054491:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 230 00000100:00100000:3.0:1787365192.054501:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2359:x1874188003457536:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365192.054573:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2359:x1874188003457536:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 74us (327us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365192.054581:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 230 00000100:00100000:0.0:1787365192.054884:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003457664 00000100:00100000:0.0:1787365192.054889:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003457664 00000100:00100000:0.0:1787365192.054931:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003457792 00000100:00100000:0.0:1787365192.054934:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003457792 00000100:00100000:0.0:1787365192.054960:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:0.0:1787365192.054968:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2359:x1874188003457664:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365192.055007:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb732680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2359:x1874188003457664:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 40us (802us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365192.055014:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:0.0:1787365192.055027:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00100000:0.0:1787365192.055034:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2359:x1874188003457792:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365192.055059:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb731c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2359:x1874188003457792:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 26us (773us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365192.055065:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00080000:3.0:1787365192.055752:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365192.572469:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787365192.572494:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024464768:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787365192.572572:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365192.573941:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024464768 00000100:00100000:3.0:1787365192.573954:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024464768 00000100:00100000:3.0:1787365192.574021:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:3.0:1787365192.574031:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024464768:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787365192.574072:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365192.574129:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c46d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024464768:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (1556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365192.574136:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00010000:00080000:0.0:1787365192.574315:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bf0f0a80 x1874188024464768/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365208 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365192.574335:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024464768:0@lo:13:osp-pre-0-0.0 00000100:00080000:2.0:1787365192.574927:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:3.0:1787365193.084761:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365193.590850:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024464896:0@lo:400:kworker.0 00000100:00100000:1.0:1787365193.590917:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365193.590961:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874188024465408:0@lo:400:kworker.0 00000100:00100000:1.0:1787365193.590986:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365193.591012:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787365193.591018:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024465280:0@lo:400:kworker.0 00000100:00100000:1.0:1787365193.591043:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365193.591073:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024465024:0@lo:400:kworker.0 00000100:00100000:1.0:1787365193.591096:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365193.591112:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024465536:0@lo:400:kworker.0 00000100:00100000:1.0:1787365193.591133:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365193.591151:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787365193.591156:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024465152:0@lo:400:kworker.0 00000100:00100000:1.0:1787365193.591193:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365193.591227:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024464896 00000100:00100000:1.0:1787365193.591234:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024464896 00000100:00100000:1.0:1787365193.591275:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787365193.591284:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3311:x1874188024464896:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365193.591332:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3311:x1874188024464896:12345-0@lo:400:kworker.0 Request processed in 49us (416us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365193.591340:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 231 00000100:00100000:1.0:1787365193.591382:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024465408 00000100:00100000:1.0:1787365193.591386:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024465408 00000100:00100000:1.0:1787365193.591551:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024465024 00000100:00100000:1.0:1787365193.591555:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024465024 00000100:00100000:1.0:1787365193.591568:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024465152 00000100:00100000:1.0:1787365193.591570:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024465152 00000100:00100000:1.0:1787365193.591585:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787365193.591591:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874188024465408:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365193.591642:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbba680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874188024465408:12345-0@lo:400:kworker.0 Request processed in 33us (637us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365193.591648:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 97 00000100:00100000:1.0:1787365193.591660:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787365193.591666:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024465024:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365193.591700:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024465024:12345-0@lo:400:kworker.0 Request processed in 33us (602us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365193.591706:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 98 00000100:00100000:1.0:1787365193.591716:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787365193.591722:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024465152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365193.591748:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024465152:12345-0@lo:400:kworker.0 Request processed in 26us (554us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365193.591754:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:1.0:1787365193.591771:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024465280 00000100:00100000:1.0:1787365193.591775:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024465280 00000100:00100000:1.0:1787365193.591798:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024465536 00000100:00100000:1.0:1787365193.591800:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024465536 00000100:00100000:1.0:1787365193.591822:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787365193.591828:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024465280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365193.591858:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024465280:12345-0@lo:400:kworker.0 Request processed in 30us (814us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365193.591870:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787365193.591882:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787365193.591887:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024465536:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365193.591917:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024465536:12345-0@lo:400:kworker.0 Request processed in 30us (783us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365193.591924:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00080000:1.0:1787365193.591952:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787365193.591957:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365193.591990:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbbb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024465152:0@lo:400:kworker.0 00000100:00100000:1.0:1787365193.592001:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024465024:0@lo:400:kworker.0 00010000:00080000:1.0:1787365193.592011:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bbbb8380 x1874188024465536/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365193.592022:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbb8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024465536:0@lo:400:kworker.0 00010000:00080000:1.0:1787365193.592063:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bbbb9880 x1874188024465280/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365209 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365193.592072:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbb9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024465280:0@lo:400:kworker.0 00000100:00100000:1.0:1787365193.592081:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024464896:0@lo:400:kworker.0 00000100:00100000:1.0:1787365193.592089:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbbad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874188024465408:0@lo:400:kworker.0 00000100:00100000:1.0:1787365193.592561:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024465664:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365193.592591:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365193.592719:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024465664 00000100:00100000:0.0:1787365193.592724:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024465664 00000100:00100000:0.0:1787365193.592769:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:0.0:1787365193.592776:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024465664:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787365193.592803:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787365193.592836:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024465664:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (244us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365193.592842:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00010000:00080000:1.0:1787365193.594162:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2786b54380 x1874188024465664/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365209 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365193.594206:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024465664:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787365194.098924:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:0.0:1787365194.306581:0:11148:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffce572ddf0 20000000:00000080:0.0:1787365194.306597:0:11148:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f27bb6b9800 uarg=0000000000000000 20000000:01000000:0.0:1787365194.306655:0:11148:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787365194.306662:0:11148:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:0.0:1787365194.306666:0:11148:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:3.0:1787365194.319571:0:11149:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 7 20000000:00000400:1.0:1787365194.319922:0:11148:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:1.0:1787365194.343405:0:11148:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787365194.346003:0:11148:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f27a12cd800/0x872d29295eb46d51 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365194.346026:0:11148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f2788f44800/0x872d29295eb46cfd lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46cf6 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365194.346037:0:11148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46d04 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f40 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365194.346043:0:11148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f2788f45c00/0x872d29295eb46d12 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46d0b expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365194.346050:0:11148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f2780030c00/0x872d29295eb46d20 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46d19 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365194.346071:0:11148:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46d35 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f78 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365194.346080:0:11148:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f27a12cd800/0x872d29295eb46d51 lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365194.346124:0:11148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46d35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f78 expref: 12 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365194.346139:0:11148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46d35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f78 expref: 12 pid: 5828 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365194.346154:0:11148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb31d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11148:1874188024465792:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365194.346277:0:11148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f2780030c00/0x872d29295eb46d20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46d19 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365194.346286:0:11148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f2780030c00/0x872d29295eb46d20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46d19 expref: 18 pid: 5828 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365194.346295:0:11148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787323100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11148:1874188024465920:0@lo:104: 00000100:00100000:2.0:1787365194.346346:0:11148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787365194.346383:0:11148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f2788f45c00/0x872d29295eb46d12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46d0b expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365194.346391:0:11148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f2788f45c00/0x872d29295eb46d12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46d0b expref: 18 pid: 5827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365194.346399:0:11148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787321180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11148:1874188024466048:0@lo:104: 00000100:00100000:2.0:1787365194.346429:0:11148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365194.346465:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024465920 00000100:00100000:2.0:1787365194.346471:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024465920 00000100:00100000:2.0:1787365194.346519:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024466048 00000100:00100000:2.0:1787365194.346523:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024466048 00000100:00100000:2.0:1787365194.346554:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787365194.346563:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787321c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+4:11148:x1874188024465920:12345-0@lo:104: 00010000:00010000:2.0:1787365194.346576:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46d19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46d20 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365194.346650:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:2.0:1787365194.346657:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787321c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+4:11148:x1874188024465920:12345-0@lo:104: Request processed in 95us (311us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365194.346673:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:2.0:1787365194.346692:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787365194.346699:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787320a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:11148:x1874188024466048:12345-0@lo:104: 00010000:00010000:2.0:1787365194.346715:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46d0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46d12 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365194.346764:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:2.0:1787365194.346770:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787320a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:11148:x1874188024466048:12345-0@lo:104: Request processed in 72us (340us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365194.346776:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00010000:00010000:2.0:1787365194.346807:0:11148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46d04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f40 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365194.346816:0:11148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46d04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f40 expref: 12 pid: 5829 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365194.346836:0:11148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787322300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11148:1874188024466176:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365194.346870:0:11148:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f2788f44800/0x872d29295eb46cfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46cf6 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365194.346878:0:11148:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f2788f44800/0x872d29295eb46cfd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46cf6 expref: 18 pid: 5828 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365194.346886:0:11148:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787321880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11148:1874188024466304:0@lo:104: 00000100:00100000:2.0:1787365194.346914:0:11148:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365194.346935:0:5817:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024466304 00000100:00100000:2.0:1787365194.346939:0:5817:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024466304 00000100:00100000:2.0:1787365194.346956:0:5817:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787365194.346962:0:5817:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798098380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:11148:x1874188024466304:12345-0@lo:104: 00010000:00010000:2.0:1787365194.346970:0:5817:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46cf6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46cfd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365194.346996:0:5817:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:2.0:1787365194.347000:0:5817:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798098380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:11148:x1874188024466304:12345-0@lo:104: Request processed in 39us (87us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365194.347006:0:5817:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:2.0:1787365194.347023:0:11148:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2787828900 going to sleep for 11 seconds 00000100:00100000:2.0:1787365194.347044:0:11148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787323100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11148:1874188024465920:0@lo:104: 00000100:00100000:2.0:1787365194.347052:0:11148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787321180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11148:1874188024466048:0@lo:104: 00000100:00100000:2.0:1787365194.347058:0:11148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787321880 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11148:1874188024466304:0@lo:104: 00010000:00010000:0.0:1787365194.350482:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787365194.350495:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46d19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46d20 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.350505:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030400 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:0.0:1787365194.350509:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46d19 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46d20 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.350519:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46d19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46d20 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365194.350525:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46d19 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46d20 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365194.350541:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787365194.350607:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46d19 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46d20 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.350614:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787365194.350659:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46d19 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46d20 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.350666:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f2780030400/0x872d29295eb46d19 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46d20 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.350679:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787365194.350683:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46d0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46d12 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.350687:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030e00 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:0.0:1787365194.350690:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46d0b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46d12 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.350695:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46d0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46d12 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365194.350702:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46d0b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46d12 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365194.350707:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787365194.350735:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46d0b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46d12 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.350741:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787365194.350748:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46d0b lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46d12 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.350762:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46d0b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46d12 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.350772:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365194.350775:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46cf6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46cfd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.350780:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a0f87a00 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:0.0:1787365194.350782:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46cf6 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46cfd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.350788:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46cf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46cfd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365194.350793:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46cf6 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46cfd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365194.350798:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787365194.350810:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46cf6 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46cfd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.350815:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787365194.350831:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46cf6 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46cfd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.350837:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87a00/0x872d29295eb46cf6 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46cfd expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.350851:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365194.350859:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365194.350861:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365194.350868:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365194.350885:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024466432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787365194.350946:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365194.350988:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787365194.350993:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024466560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787365194.351014:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365194.351040:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024466688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787365194.351059:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365194.351084:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024466432 00000100:00100000:0.0:1787365194.351090:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024466432 00010000:00010000:0.0:1787365194.351116:0:8434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f2780030c00/0x872d29295eb46d20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46d19 expref: 19 pid: 5828 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365194.351139:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024466560 00000100:00100000:0.0:1787365194.351142:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024466560 00010000:00010000:0.0:1787365194.351152:0:8434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f2788f45c00/0x872d29295eb46d12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46d0b expref: 20 pid: 5827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365194.351167:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024466688 00000100:00100000:0.0:1787365194.351186:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024466688 00010000:00010000:0.0:1787365194.351197:0:8434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f2788f44800/0x872d29295eb46cfd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46cf6 expref: 21 pid: 5828 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365194.351210:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787365194.351217:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65f8cd6c-cad4-438a-a88d-c44efaabba70+21:3310:x1874188024466432:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787365194.351227:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365194.351232:0:8434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f2780030c00/0x872d29295eb46d20 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46d19 expref: 21 pid: 5828 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.351247:0:8434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f2780030c00/0x872d29295eb46d20 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46d19 expref: 21 pid: 5828 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.351260:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2780030c00/0x872d29295eb46d20 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46d19 expref: 21 pid: 5828 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.351272:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365194.351319:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e1b850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65f8cd6c-cad4-438a-a88d-c44efaabba70+20:3310:x1874188024466432:12345-0@lo:103:ldlm_bl.0 Request processed in 88us (358us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365194.351327:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:0.0:1787365194.351368:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787365194.351374:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024466560:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787365194.351381:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365194.351385:0:8434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f2788f45c00/0x872d29295eb46d12 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46d0b expref: 19 pid: 5827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.351393:0:8434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f2788f45c00/0x872d29295eb46d12 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46d0b expref: 19 pid: 5827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.351403:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2788f45c00/0x872d29295eb46d12 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46d0b expref: 19 pid: 5827 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.351410:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365194.351434:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaace00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:3310:x1874188024466560:12345-0@lo:103:ldlm_bl.0 Request processed in 61us (418us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365194.351440:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787365194.351453:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787365194.351459:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:3312:x1874188024466688:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787365194.351473:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365194.351478:0:8434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f2788f44800/0x872d29295eb46cfd lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46cf6 expref: 17 pid: 5828 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.351485:0:8434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f2788f44800/0x872d29295eb46cfd lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46cf6 expref: 17 pid: 5828 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.351495:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2788f44800/0x872d29295eb46cfd lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46cf6 expref: 17 pid: 5828 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.351504:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365194.351543:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:3312:x1874188024466688:12345-0@lo:103:ldlm_bl.0 Request processed in 73us (470us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365194.351550:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:0.0:1787365194.351593:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024466688:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787365194.351617:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024466560:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787365194.351651:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b54380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024466432:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787365194.353108:0:11148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb31d180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11148:1874188024465792:192.168.203.13@tcp:104: 00000100:00100000:0.0:1787365194.353119:0:11148:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787322300 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11148:1874188024466176:192.168.203.13@tcp:104: 00010000:00010000:0.0:1787365194.353148:0:11148:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f27a12cd800/0x872d29295eb46d51 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365194.356063:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365194.356150:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365194.356609:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003457920 00000100:00100000:1.0:1787365194.356619:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003457920 00010000:00010000:1.0:1787365194.356678:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46d35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f78 expref: 13 pid: 5828 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365194.356709:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003458048 00000100:00100000:1.0:1787365194.356712:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003458048 00010000:00010000:1.0:1787365194.356726:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46d04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f40 expref: 14 pid: 5829 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365194.356743:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:1.0:1787365194.356751:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c0d7a78e-143d-4100-8e74-6d9e2f230c05+14:2362:x1874188003457920:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365194.356767:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365194.356772:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46d35 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f78 expref: 14 pid: 5828 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365194.356784:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46d35 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f78 expref: 14 pid: 5828 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365194.356800:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46d35 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f78 expref: 14 pid: 5828 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365194.356816:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365194.356861:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f1180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2362:x1874188003457920:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 111us (807us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365194.356884:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:1.0:1787365194.356903:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:1.0:1787365194.356909:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c0d7a78e-143d-4100-8e74-6d9e2f230c05+12:2362:x1874188003458048:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365194.356916:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365194.356920:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46d04 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f40 expref: 12 pid: 5829 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365194.356929:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46d04 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f40 expref: 12 pid: 5829 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365194.356939:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a12ccc00/0x872d29295eb46d04 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f40 expref: 12 pid: 5829 timeout: 411 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365194.356948:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f27a12cd800/0x872d29295eb46d51 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365194.356957:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a12cd800/0x872d29295eb46d51 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365194.356971:0:8435:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f27a12cd800/0x872d29295eb46d51 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365194.356978:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f27a12cd800/0x872d29295eb46d51 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365194.356984:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f27a12cd800/0x872d29295eb46d51 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365194.356991:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f27a12cd800/0x872d29295eb46d51 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365194.357002:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cd800 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365194.357006:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f27a12cd800/0x872d29295eb46d51 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365194.357013:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f27a12cd800/0x872d29295eb46d51 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365194.357025:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f27a12cd800/0x872d29295eb46d51 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365194.357034:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365194.357053:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c0d7a78e-143d-4100-8e74-6d9e2f230c05+11:2362:x1874188003458048:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 144us (904us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365194.357059:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00010000:00010000:0.0:1787365194.357609:0:11148:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f27a12cd800/0x872d29295eb46d51 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.357620:0:11148:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f27a12cd800/0x872d29295eb46d51 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365194.357668:0:11148:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a12cd800/0x872d29295eb46d51 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11148 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365195.123774:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787365195.378724:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787365195.378732:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f27882fe000 from 7 10000000:01000000:3.0:1787365195.378736:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787365195.378781:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2788f44c00/0x872d29295eb46d58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365195.378793:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2788f44c00/0x872d29295eb46d58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365195.378816:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2788f44c00/0x872d29295eb46d58 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365195.378848:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024466816:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787365195.378912:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365195.379009:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6af7180 going to sleep for 11 seconds 00000100:00100000:1.0:1787365195.379058:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024466816 00000100:00100000:1.0:1787365195.379065:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024466816 00000100:00100000:1.0:1787365195.379114:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 232 00000100:00100000:1.0:1787365195.379124:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:5832:x1874188024466816:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787365195.379135:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365195.379148:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2798115c00/0x872d29295eb46d5f lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46d58 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365195.379170:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2798115c00/0x872d29295eb46d5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46d58 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365195.379180:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2798115c00/0x872d29295eb46d5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46d58 expref: 17 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365195.379189:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115c00, rc 0) 00000100:00100000:1.0:1787365195.379281:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024466816:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 158us (367us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365195.379289:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 232 00000100:00100000:3.0:1787365195.379358:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024466816:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787365195.379370:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2788f44c00/0x872d29295eb46d58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46d5f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365195.379379:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2788f44c00/0x872d29295eb46d58 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46d5f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365195.379429:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024466944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365195.379453:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365195.379597:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6af7180 going to sleep for 11 seconds 00000100:00100000:1.0:1787365195.379695:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024466944 00000100:00100000:1.0:1787365195.379701:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024466944 00000100:00100000:1.0:1787365195.379729:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 233 00000100:00100000:1.0:1787365195.379736:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024466944:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787365195.380015:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024466944:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 278us (560us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365195.380023:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 233 00000100:00100000:3.0:1787365195.380083:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024466944:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365195.380115:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024467072:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787365195.380155:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365195.380218:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6af7180 going to sleep for 11 seconds 00000100:00100000:1.0:1787365195.380254:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024467072 00000100:00100000:1.0:1787365195.380258:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024467072 00000100:00100000:1.0:1787365195.380290:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 234 00000100:00100000:1.0:1787365195.380298:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024467072:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787365195.380597:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024467072:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 299us (441us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365195.380604:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 234 00000100:00100000:3.0:1787365195.380922:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024467072:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787365195.382237:0:11162:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787365195.382403:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787365195.382422:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787365195.382431:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2788f44c00/0x872d29295eb46d58 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46d5f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365195.382451:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2788f44c00/0x872d29295eb46d58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46d5f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365195.382461:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787365195.382463:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f27a01d6000 from 7 10000000:01000000:3.0:1787365195.382465:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787365195.382496:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2788f45000/0x872d29295eb46d66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365195.382503:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2788f45000/0x872d29295eb46d66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365195.382589:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2788f45000/0x872d29295eb46d66 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365195.382614:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024467200:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787365195.382734:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365195.382795:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6af7180 going to sleep for 11 seconds 00000100:00100000:1.0:1787365195.382836:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024467200 00000100:00100000:1.0:1787365195.382842:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024467200 00000100:00100000:1.0:1787365195.382881:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 235 00000100:00100000:1.0:1787365195.382889:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024467200:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787365195.382901:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365195.382912:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2798114c00/0x872d29295eb46d6d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46d66 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365195.382933:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2798114c00/0x872d29295eb46d6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46d66 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365195.382952:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2798114c00/0x872d29295eb46d6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46d66 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365195.382961:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798114c00, rc 0) 00000100:00100000:1.0:1787365195.383032:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024467200:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 144us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365195.383039:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 235 00000100:00100000:3.0:1787365195.383090:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024467200:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787365195.383103:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2788f45000/0x872d29295eb46d66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46d6d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365195.383111:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2788f45000/0x872d29295eb46d66 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46d6d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365195.383153:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024467328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365195.383175:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365195.383226:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6af7180 going to sleep for 11 seconds 00000100:00100000:1.0:1787365195.383259:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024467328 00000100:00100000:1.0:1787365195.383263:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024467328 00000100:00100000:1.0:1787365195.383289:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 236 00000100:00100000:1.0:1787365195.383294:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024467328:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787365195.383600:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024467328:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 304us (422us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365195.383607:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 236 00000100:00100000:3.0:1787365195.383691:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024467328:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365195.383718:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024467456:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787365195.383755:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365195.383805:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6af7180 going to sleep for 11 seconds 00000100:00100000:1.0:1787365195.383838:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024467456 00000100:00100000:1.0:1787365195.383842:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024467456 00000100:00100000:1.0:1787365195.383868:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 237 00000100:00100000:1.0:1787365195.383874:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024467456:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787365195.384040:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024467456:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 165us (284us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365195.384047:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 237 00000100:00100000:3.0:1787365195.384098:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024467456:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787365195.385339:0:11163:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787365195.385498:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787365195.385611:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787365195.385688:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2788f45000/0x872d29295eb46d66 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46d6d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365195.385699:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2788f45000/0x872d29295eb46d66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46d6d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365195.385710:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787365195.385712:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f2797a7c800 from 7 10000000:01000000:3.0:1787365195.385715:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787365195.385745:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2788f45200/0x872d29295eb46d74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365195.385753:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2788f45200/0x872d29295eb46d74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365195.385762:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2788f45200/0x872d29295eb46d74 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365195.385781:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024467584:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787365195.385832:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365195.385908:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6af7180 going to sleep for 11 seconds 00000100:00100000:1.0:1787365195.385943:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024467584 00000100:00100000:1.0:1787365195.385948:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024467584 00000100:00100000:1.0:1787365195.385980:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 238 00000100:00100000:1.0:1787365195.385986:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024467584:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787365195.386001:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365195.386011:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2798115000/0x872d29295eb46d7b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46d74 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365195.386027:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2798115000/0x872d29295eb46d7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46d74 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365195.386034:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2798115000/0x872d29295eb46d7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46d74 expref: 19 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365195.386039:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115000, rc 0) 00000100:00100000:1.0:1787365195.386099:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:5832:x1874188024467584:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (268us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365195.386104:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 238 00000100:00100000:3.0:1787365195.386150:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024467584:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787365195.386162:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2788f45200/0x872d29295eb46d74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46d7b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365195.386169:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2788f45200/0x872d29295eb46d74 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46d7b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365195.386212:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024467712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365195.386236:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365195.386287:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6af7180 going to sleep for 11 seconds 00000100:00100000:1.0:1787365195.386321:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024467712 00000100:00100000:1.0:1787365195.386324:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024467712 00000100:00100000:1.0:1787365195.386346:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 239 00000100:00100000:1.0:1787365195.386350:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:5832:x1874188024467712:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365195.386582:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024467712:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787365195.386583:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:5832:x1874188024467712:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 230us (345us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365195.386590:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 239 00000100:00100000:3.0:1787365195.386607:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024467840:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787365195.386663:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365195.386688:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6af7180 going to sleep for 11 seconds 00000100:00100000:1.0:1787365195.386701:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024467840 00000100:00100000:1.0:1787365195.386705:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024467840 00000100:00100000:1.0:1787365195.386772:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 240 00000100:00100000:1.0:1787365195.386779:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:5832:x1874188024467840:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787365195.386926:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:5832:x1874188024467840:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 147us (263us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365195.386941:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 240 00000100:00100000:3.0:1787365195.387004:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f2d80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024467840:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787365195.388063:0:11164:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 7 00000020:01000000:3.0:1787365195.388179:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-6 (rc=0) 10000000:01000000:3.0:1787365195.388193:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787365195.388201:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2788f45200/0x872d29295eb46d74 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46d7b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365195.388209:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2788f45200/0x872d29295eb46d74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46d7b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365196.146776:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365196.278789:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365196.278874:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003458176 00000100:00100000:3.0:1787365196.278883:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003458176 00000100:00100000:3.0:1787365196.278939:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 241 00000100:00100000:3.0:1787365196.278962:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+11:5599:x1874188003458176:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787365196.278981:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365196.279000:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2788f45600/0x872d29295eb46d82 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988fa2 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365196.279029:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2788f45600/0x872d29295eb46d82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fa2 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365196.279039:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2788f45600/0x872d29295eb46d82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fa2 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365196.279048:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45600, rc 0) 00000100:00100000:3.0:1787365196.280812:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+12:5599:x1874188003458176:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 1842us (2023us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365196.280824:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 241 00000100:00100000:3.0:1787365196.292326:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365196.293495:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003458304 00000100:00100000:1.0:1787365196.293507:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003458304 00000100:00100000:1.0:1787365196.293589:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 242 00000100:00100000:1.0:1787365196.293600:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+12:5599:x1874188003458304:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787365196.294367:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+12:5599:x1874188003458304:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 767us (2048us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365196.294377:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 242 00000100:00100000:1.0:1787365196.309474:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365196.309899:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003458432 00000100:00100000:3.0:1787365196.309910:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003458432 00000100:00100000:3.0:1787365196.309960:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 243 00000100:00100000:3.0:1787365196.309971:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+12:5599:x1874188003458432:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787365196.310208:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+12:5599:x1874188003458432:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 238us (741us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365196.310216:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 243 00000100:00100000:1.0:1787365196.346434:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365196.346582:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003458560 00000100:00100000:2.0:1787365196.346590:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003458560 00000100:00100000:2.0:1787365196.346672:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 244 00000100:00100000:2.0:1787365196.346681:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+12:5599:x1874188003458560:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787365196.346697:0:5829:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365196.346712:0:5829:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a12cc800/0x872d29295eb46d89 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988fa9 expref: -99 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365196.346740:0:5829:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a12cc800/0x872d29295eb46d89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fa9 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365196.346751:0:5829:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a12cc800/0x872d29295eb46d89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fa9 expref: 13 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365196.346760:0:5829:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cc800, rc 0) 00000100:00100000:2.0:1787365196.346808:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:5599:x1874188003458560:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 128us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365196.346815:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 244 00000100:00100000:1.0:1787365196.353900:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365196.354211:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003458688 00000100:00100000:3.0:1787365196.354222:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003458688 00000100:00100000:3.0:1787365196.354287:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 245 00000100:00100000:3.0:1787365196.354297:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:5599:x1874188003458688:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365196.354852:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:5599:x1874188003458688:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 554us (958us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365196.354861:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 245 00000100:00100000:1.0:1787365196.356867:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365196.356953:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003458816 00000100:00100000:3.0:1787365196.356963:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003458816 00000100:00100000:3.0:1787365196.357020:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 246 00000100:00100000:3.0:1787365196.357030:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:5599:x1874188003458816:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787365196.357231:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:5599:x1874188003458816:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 202us (372us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365196.357246:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 246 00010000:00010000:0.0:1787365197.183122:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365197.188891:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365197.188933:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365197.188963:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003458944 00000100:00100000:1.0:1787365197.188972:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003458944 00000100:00100000:1.0:1787365197.189019:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 247 00000100:00100000:1.0:1787365197.189030:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2360:x1874188003458944:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365197.189097:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795d450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2360:x1874188003458944:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 68us (162us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365197.189105:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 247 00000100:00100000:1.0:1787365197.189157:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365197.189270:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003459072 00000100:00100000:1.0:1787365197.189280:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003459072 00000100:00100000:1.0:1787365197.189318:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003459200 00000100:00100000:1.0:1787365197.189322:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003459200 00000100:00100000:1.0:1787365197.189347:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:1.0:1787365197.189356:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2360:x1874188003459072:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365197.189396:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2360:x1874188003459072:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 42us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365197.189403:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:1.0:1787365197.189792:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:1.0:1787365197.189800:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2360:x1874188003459200:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365197.189830:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2360:x1874188003459200:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 31us (673us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365197.189836:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00080000:1.0:1787365197.189853:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365197.682895:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787365197.683201:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024467968:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787365197.683268:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365197.683400:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024467968 00000100:00100000:0.0:1787365197.683408:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024467968 00000100:00100000:0.0:1787365197.683475:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:0.0:1787365197.683485:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024467968:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787365197.683523:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:1.0:1787365197.683652:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787365197.683685:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bbaad880 x1874188024467968/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365213 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365197.683705:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaad880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024467968:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787365197.683779:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024467968:12345-0@lo:13:osp-pre-0-0.0 Request processed in 292us (507us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365197.683787:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00010000:00010000:0.0:1787365198.195770:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365198.712856:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024468096:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365198.712924:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365198.712971:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024468608:0@lo:400:kworker.0 00000100:00100000:1.0:1787365198.712996:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365198.713022:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:1.0:1787365198.713038:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024468224:0@lo:400:kworker.0 00000100:00100000:1.0:1787365198.713066:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365198.713089:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874188024468736:0@lo:400:kworker.0 00000100:00100000:1.0:1787365198.713112:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365198.713138:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024468352:0@lo:400:kworker.0 00000100:00100000:1.0:1787365198.713162:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365198.713177:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024468864:0@lo:400:kworker.0 00000100:00100000:1.0:1787365198.713211:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365198.713231:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787365198.713235:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024468480:0@lo:400:kworker.0 00000100:00100000:1.0:1787365198.718680:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365198.718755:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024468096 00000100:00100000:1.0:1787365198.718763:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024468096 00000100:00100000:1.0:1787365198.718818:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787365198.718829:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024468096:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787365198.718868:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365198.718914:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbbad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024468096:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (5990us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365198.718921:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787365198.718945:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024468608 00000100:00100000:1.0:1787365198.718948:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024468608 00000100:00100000:1.0:1787365198.718970:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024468864 00000100:00100000:1.0:1787365198.718973:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024468864 00000100:00100000:1.0:1787365198.718988:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787365198.718993:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024468608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365198.719026:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbb9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024468608:12345-0@lo:400:kworker.0 Request processed in 33us (6029us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365198.719047:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:1.0:1787365198.719059:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787365198.719065:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2686973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024468864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365198.719099:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2686973100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024468864:12345-0@lo:400:kworker.0 Request processed in 34us (5887us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365198.719105:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787365198.719125:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024468224 00000100:00100000:1.0:1787365198.719130:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024468224 00000100:00100000:1.0:1787365198.719153:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787365198.719159:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024468224:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365198.719190:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795e850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024468224:12345-0@lo:400:kworker.0 Request processed in 31us (6123us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365198.719195:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 248 00000100:00100000:1.0:1787365198.719221:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024468736 00000100:00100000:1.0:1787365198.719224:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024468736 00000100:00100000:1.0:1787365198.719252:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024468352 00000100:00100000:1.0:1787365198.719255:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024468352 00000100:00100000:1.0:1787365198.719264:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024468480 00000100:00100000:1.0:1787365198.719266:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024468480 00000100:00100000:1.0:1787365198.719278:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787365198.719283:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874188024468736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365198.719314:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbb8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874188024468736:12345-0@lo:400:kworker.0 Request processed in 30us (6200us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365198.719319:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 102 00000100:00100000:1.0:1787365198.719328:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787365198.719332:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024468352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365198.719368:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbbb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024468352:12345-0@lo:400:kworker.0 Request processed in 35us (6205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365198.719374:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787365198.719387:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 104 00000100:00100000:1.0:1787365198.719392:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2686973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024468480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365198.719417:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2686973480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024468480:12345-0@lo:400:kworker.0 Request processed in 25us (745us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365198.719422:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 104 00000100:00080000:1.0:1787365198.719447:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787365198.719452:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787365198.719479:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024468224:0@lo:400:kworker.0 00000100:00100000:1.0:1787365198.719494:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874188024468736:0@lo:400:kworker.0 00000100:00100000:0.0:1787365198.721228:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb730e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024468480:0@lo:400:kworker.0 00000100:00100000:0.0:1787365198.721245:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb731180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024468352:0@lo:400:kworker.0 00010000:00080000:0.0:1787365198.721261:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb730380 x1874188024468864/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365198.721271:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb730380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024468864:0@lo:400:kworker.0 00010000:00080000:1.0:1787365198.722621:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bbdc5180 x1874188024468096/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365214 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365198.722677:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024468096:0@lo:13:osp-pre-1-0.0 00010000:00080000:0.0:1787365198.722781:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb733100 x1874188024468608/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365214 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365198.722791:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb733100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024468608:0@lo:400:kworker.0 00000001:02000400:0.0:1787365198.928497:0:11346:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:0.0:1787365199.218811:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365200.244384:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365201.270719:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365202.290984:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365202.292846:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365202.292985:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365202.293032:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365202.293143:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003459584 00000100:00100000:0.0:1787365202.293148:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003459456 00000100:00100000:2.0:1787365202.293157:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003459584 00000100:00100000:0.0:1787365202.293163:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003459456 00000100:00080000:1.0:1787365202.293256:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365202.293320:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 105 00000100:00100000:2.0:1787365202.293334:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2686971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2360:x1874188003459584:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1787365202.293446:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2686971880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2360:x1874188003459584:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 116us (460us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365202.293456:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 105 00000100:00100000:3.0:1787365202.299313:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003459328 00000100:00100000:3.0:1787365202.299332:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003459328 00000100:00100000:3.0:1787365202.299441:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 249 00000100:00100000:3.0:1787365202.299453:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2360:x1874188003459328:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365202.299703:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2360:x1874188003459328:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 252us (6871us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365202.299713:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 249 00000100:00100000:0.0:1787365202.302083:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 106 00000100:00100000:0.0:1787365202.302118:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2686971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2360:x1874188003459456:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365202.302196:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2686971180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2360:x1874188003459456:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 101us (9163us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365202.302204:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 106 00000100:00100000:1.0:1787365202.804010:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024468992:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787365202.804104:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365202.804319:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024468992 00000100:00100000:0.0:1787365202.804330:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024468992 00000100:00100000:0.0:1787365202.804411:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787365202.804423:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2686970e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024468992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787365202.804466:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787365202.804530:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2686970e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024468992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 109us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365202.804538:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00080000:1.0:1787365202.804653:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787365202.804689:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bbaad180 x1874188024468992/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365218 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365202.804708:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024468992:0@lo:13:osp-pre-0-0.0 00000001:02000400:2.0:1787365203.224797:0:11446:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: === sanity-pcc: finish setup 22:20:00 (1787365200) === 00010000:00010000:0.0:1787365203.328576:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365203.482069:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365203.482197:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003459712 00000100:00100000:1.0:1787365203.482207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365203.482220:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003459712 00000100:00100000:2.0:1787365203.482307:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:3.0:1787365203.482311:0:5842:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003459840 00000100:00100000:3.0:1787365203.482317:0:5842:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003459840 00000100:00100000:2.0:1787365203.482322:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2686970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2359:x1874188003459712:12345-192.168.203.13@tcp:41:mkdir.0 00000100:00100000:3.0:1787365203.482361:0:5842:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:3.0:1787365203.482370:0:5842:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2686970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:9684:x1874188003459840:12345-192.168.203.13@tcp:700:mkdir.0 00000004:00000024:2.0:1787365203.482395:0:5835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787365203.482477:0:5842:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2686970700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:9684:x1874188003459840:12345-192.168.203.13@tcp:700:mkdir.0 Request processed in 99us (261us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365203.482486:0:5842:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1787365203.491577:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2686970a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2359:x1874188003459712:12345-192.168.203.13@tcp:41:mkdir.0 Request processed in 9241us (9502us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365203.491598:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1787365203.496854:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365203.496982:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003460096 00000100:00100000:0.0:1787365203.496995:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003460096 00000100:00100000:0.0:1787365203.497077:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:0.0:1787365203.497105:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2686970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:9684:x1874188003460096:12345-192.168.203.13@tcp:36:mkdir.0 00010000:00010000:0.0:1787365203.497180:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365203.499036:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb46c71 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f2b expref: 6 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.499072:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f27988df000) 00010000:00010000:0.0:1787365203.499100:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787365203.501804:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030c00/0x872d29295eb46d90 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.501826:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030c00/0x872d29295eb46d90 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.501840:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030c00/0x872d29295eb46d90 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.501902:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb46d97 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.501911:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb46d97 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.501917:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb46d97 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365203.510815:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00010000:00010000:0.0:1787365203.510836:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030c00/0x872d29295eb46d90 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.510847:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030c00/0x872d29295eb46d90 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.510873:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030c00/0x872d29295eb46d90 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.510878:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365203.510882:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030c00/0x872d29295eb46d90 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.510889:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030c00/0x872d29295eb46d90 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.510907:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f278a0ad500) 00010000:00010000:0.0:1787365203.510910:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365203.510914:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030c00/0x872d29295eb46d90 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.510921:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030c00/0x872d29295eb46d90 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787365203.510942:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d4273bcf reply state 00000000e13a69ba transno 4294967297 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb46d97 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365203.510950:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787365203.511059:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2686970000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:9684:x1874188003460096:12345-192.168.203.13@tcp:36:mkdir.0 Request processed in 13952us (14213us total) trans 4294967297 rc 0/0 00000100:00100000:0.0:1787365203.511068:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00010000:00010000:3.0:1787365203.512991:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb46d97 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365203.513012:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb46d97 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365203.513020:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb46d97 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365203.513106:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030e00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365203.513113:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb46d97 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365203.513123:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb46d97 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365203.513147:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f278a0ad400) 00010000:00010000:3.0:1787365203.513151:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365203.513157:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb46d97 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365203.513164:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb46d97 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365203.545903:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365203.547084:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003460224 00000100:00100000:0.0:1787365203.547098:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003460224 00000100:00100000:0.0:1787365203.547180:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1787365203.547191:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2686971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:9685:x1874188003460224:12345-192.168.203.13@tcp:101:chmod.0 00010000:00010000:0.0:1787365203.547228:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365203.547252:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030c00/0x872d29295eb46d9e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988fb0 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.547319:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030400/0x872d29295eb46da5 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.547334:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030400/0x872d29295eb46da5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.547803:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030400/0x872d29295eb46da5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787365203.548528:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787365203.548541:0:6704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787365203.548694:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030400/0x872d29295eb46da5 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.548742:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030c00/0x872d29295eb46d9e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fb0 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.548771:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030400/0x872d29295eb46da5 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fb0 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.548781:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f278a0ad500) 00010000:00010000:1.0:1787365203.548784:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787365203.548788:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780030400, rc 0) 00000100:00100000:1.0:1787365203.548887:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2686971f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:9685:x1874188003460224:12345-192.168.203.13@tcp:101:chmod.0 Request processed in 1695us (2998us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365203.548898:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:1.0:1787365203.555679:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365203.555941:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003460480 00000100:00100000:2.0:1787365203.555956:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003460480 00000100:00100000:2.0:1787365203.556035:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:2.0:1787365203.556047:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2686972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:9685:x1874188003460480:12345-192.168.203.13@tcp:36:chmod.0 00010000:00010000:2.0:1787365203.556133:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365203.556168:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030400/0x872d29295eb46da5 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fb0 expref: 7 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.556191:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f278a0ad500) 00010000:00010000:2.0:1787365203.556203:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787365203.556235:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46dac lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.556252:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46dac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.556264:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46dac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787365203.556867:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000b6867f37 reply state 00000000e1603cdd transno 4294967298 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46dac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365203.556879:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787365203.556896:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000100:00100000:2.0:1787365203.557016:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2686972a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:9685:x1874188003460480:12345-192.168.203.13@tcp:36:chmod.0 Request processed in 969us (1350us total) trans 4294967298 rc 0/0 00000100:00100000:2.0:1787365203.557025:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00010000:00010000:0.0:1787365203.560006:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46dac lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.560026:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46dac lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.560034:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46dac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.560040:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12ccc00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365203.560045:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46dac lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.560065:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46dac lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.560085:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f27988df100) 00010000:00010000:0.0:1787365203.560088:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787365203.560112:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46dac lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.560118:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46dac lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365203.589148:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365203.591503:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003460608 00000100:00100000:0.0:1787365203.591533:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003460608 00000100:00100000:1.0:1787365203.591778:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:1.0:1787365203.591796:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2686972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:9686:x1874188003460608:12345-192.168.203.13@tcp:101:chown.0 00010000:00010000:1.0:1787365203.591830:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365203.591860:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114e00/0x872d29295eb46db3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988fb7 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.592081:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114600/0x872d29295eb46dba lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.592160:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114600/0x872d29295eb46dba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.592180:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114600/0x872d29295eb46dba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787365203.592376:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 6656 00000004:00200000:1.0:1787365203.592382:0:6704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787365203.592432:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114600/0x872d29295eb46dba lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.594538:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114e00/0x872d29295eb46db3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fb7 expref: 9 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.594591:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114600/0x872d29295eb46dba lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fb7 expref: 8 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.594603:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2784761900) 00010000:00010000:1.0:1787365203.594606:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787365203.594611:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798114600, rc 0) 00000100:00100000:1.0:1787365203.594844:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2686972680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:9686:x1874188003460608:12345-192.168.203.13@tcp:101:chown.0 Request processed in 3049us (5706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365203.594855:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:1.0:1787365203.603382:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365203.605016:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003460736 00000100:00100000:2.0:1787365203.605059:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003460736 00000100:00100000:2.0:1787365203.605152:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:2.0:1787365203.605164:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2686973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:9686:x1874188003460736:12345-192.168.203.13@tcp:101:chown.0 00010000:00010000:2.0:1787365203.605191:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365203.605220:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46dc1 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988fbe expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.605308:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb46dc8 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.605325:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb46dc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.605339:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb46dc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.605358:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46dcf lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.605365:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46dcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.605372:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46dcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.607070:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb46dd6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.607092:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb46dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.607106:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb46dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365203.607184:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787365203.607189:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365203.607217:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb46dd6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.607233:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb46dc8 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.607240:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb46dc8 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.607248:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb46dc8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.607254:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cd400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365203.607258:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb46dc8 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.607266:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb46dc8 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.607281:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2784761900) 00010000:00010000:2.0:1787365203.607283:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365203.607288:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb46dc8 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.607294:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb46dc8 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.607310:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46dcf lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.607326:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46dcf lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.607333:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46dcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.607339:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12ccc00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365203.607341:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46dcf lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.607347:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46dcf lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.607354:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f27988df200) 00010000:00010000:2.0:1787365203.607357:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365203.607359:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46dcf lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.607365:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46dcf lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.607409:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46dc1 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fbe expref: 10 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.607423:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb46dd6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fbe expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.607430:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f27988dff00) 00010000:00010000:2.0:1787365203.607432:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787365203.607439:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cca00, rc 0) 00000100:00100000:2.0:1787365203.609729:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2686973800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:9686:x1874188003460736:12345-192.168.203.13@tcp:101:chown.0 Request processed in 4545us (6339us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365203.609745:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:0.0:1787365203.615963:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365203.616093:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003460992 00000100:00100000:1.0:1787365203.616133:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003460992 00000100:00100000:1.0:1787365203.616220:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:1.0:1787365203.616232:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:9686:x1874188003460992:12345-192.168.203.13@tcp:36:chown.0 00010000:00010000:1.0:1787365203.616310:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365203.616346:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb46dd6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fbe expref: 9 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.616371:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f27988dff00) 00010000:00010000:1.0:1787365203.616383:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787365203.616417:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb46ddd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.616433:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb46ddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.616446:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb46ddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787365203.728323:0:6704:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000036dec6f5 reply state 00000000763c750c transno 4294967299 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb46ddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365203.728350:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:1.0:1787365203.728616:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000100:00100000:1.0:1787365203.728790:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaac700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+10:9686:x1874188003460992:12345-192.168.203.13@tcp:36:chown.0 Request processed in 112554us (112835us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787365203.728802:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000001:00080000:2.0:1787365203.729289:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967297 is committed 00000001:00080000:2.0:1787365203.729328:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967299 is committed 00010000:00010000:1.0:1787365203.730110:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb46ddd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.730127:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb46ddd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.730150:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb46ddd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.730157:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365203.730162:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb46ddd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.730171:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb46ddd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.730263:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f2784761700) 00010000:00010000:1.0:1787365203.730268:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:1.0:1787365203.730275:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb46ddd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.730283:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb46ddd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0x0 bits 0x12/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365203.751322:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365203.751504:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003461120 00000100:00100000:1.0:1787365203.751528:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003461120 00000100:00100000:1.0:1787365203.751603:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:1.0:1787365203.751614:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:9687:x1874188003461120:12345-192.168.203.13@tcp:101:touch.500 00010000:00010000:1.0:1787365203.751690:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365203.751716:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb46de4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988fc5 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787365203.753346:0:5834:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 500, time 1559us 00010000:00010000:2.0:1787365203.784287:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46deb lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.784319:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46deb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.784333:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46deb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.784352:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46df2 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.784359:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46df2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.784365:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46df2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.785012:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb46df9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.785022:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb46df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.785031:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb46df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365203.785136:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787365203.785142:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365203.785245:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb46df9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.785262:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46deb lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.785269:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46deb lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.785276:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46deb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.785282:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cd800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365203.785287:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46deb lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.785296:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46deb lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.785311:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2784761900) 00010000:00010000:2.0:1787365203.785315:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365203.785321:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46deb lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.785327:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46deb lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.785341:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46df2 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.785357:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46df2 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.785363:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46df2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.785368:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12ccc00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365203.785371:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46df2 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.785378:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46df2 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.785388:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f27988df900) 00010000:00010000:2.0:1787365203.785391:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365203.785394:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46df2 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.785401:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46df2 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.785451:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb46de4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fc5 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.785481:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb46df9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fc5 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.785488:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f27988df200) 00010000:00010000:2.0:1787365203.785490:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:2.0:1787365203.785500:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cd400, rc 0) 00000100:00100000:2.0:1787365203.785605:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaac000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:9687:x1874188003461120:12345-192.168.203.13@tcp:101:touch.500 Request processed in 33990us (34295us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365203.785617:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:1.0:1787365203.796393:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365203.796527:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003461376 00000100:00100000:2.0:1787365203.796539:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003461376 00000100:00100000:2.0:1787365203.796614:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:2.0:1787365203.796661:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2686972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:9687:x1874188003461376:12345-192.168.203.13@tcp:101:touch.500 00010000:00010000:2.0:1787365203.796688:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365203.796715:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46e00 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988fcc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.797110:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46e07 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.797126:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46e07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.797139:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46e07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365203.803751:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb46e0e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365203.803784:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb46e0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365203.803801:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb46e0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787365203.805371:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x2:0x0], index 1: 0 00010000:00010000:3.0:1787365203.809892:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb46e15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365203.809921:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb46e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365203.809937:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb46e15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365203.809987:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46e07 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365203.809995:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46e07 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365203.810002:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46e07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365203.810010:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cd800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365203.810016:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46e07 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365203.810024:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46e07 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365203.810039:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f27988df200) 00010000:00010000:3.0:1787365203.810042:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365203.810047:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46e07 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365203.811404:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46e07 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787365203.811434:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000007dfc3ec7 reply state 00000000f6ce4674 transno 4294967300 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb46e0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365203.811521:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787365203.811592:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46e00 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fcc expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365203.811611:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb46e15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fcc expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365203.811620:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f2789e48300) 00010000:00010000:3.0:1787365203.811623:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787365203.811642:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44200, rc 0) 00000100:00100000:3.0:1787365203.811746:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2686972300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+10:9687:x1874188003461376:12345-192.168.203.13@tcp:101:touch.500 Request processed in 15121us (15365us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787365203.811758:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00010000:00010000:0.0:1787365203.818149:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb46e0e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.818174:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb46e0e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.818183:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb46e0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.818190:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45e00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365203.818195:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb46e0e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.818204:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb46e0e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.818229:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xda9a1529 (ffff9f27988df900) 00010000:00010000:0.0:1787365203.818232:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365203.818238:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb46e0e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.818248:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb46e0e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365203.819257:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365203.819671:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003461632 00000100:00100000:2.0:1787365203.819684:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003461632 00000100:00100000:2.0:1787365203.819759:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:2.0:1787365203.819772:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2686973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:9687:x1874188003461632:12345-192.168.203.13@tcp:36:touch.500 00010000:00010000:2.0:1787365203.819851:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365203.819885:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb46e15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fcc expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.819927:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f2789e48300) 00010000:00010000:2.0:1787365203.819939:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787365203.819999:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46e23 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.820016:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.820028:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787365203.820230:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b82815e reply state 00000000233f3974 transno 4294967301 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365203.820242:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787365203.820366:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2686973b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+10:9687:x1874188003461632:12345-192.168.203.13@tcp:36:touch.500 Request processed in 596us (1118us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787365203.820375:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:3.0:1787365203.823882:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365203.823976:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003461760 00000100:00100000:2.0:1787365203.823989:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003461760 00000100:00100000:2.0:1787365203.824061:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:2.0:1787365203.824073:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+10:9687:x1874188003461760:12345-192.168.203.13@tcp:101:touch.500 00010000:00010000:2.0:1787365203.824113:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365203.824142:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb46e2a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988fd3 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.824227:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb46e2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fd3 expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.824275:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb46e2a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fd3 expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365203.824300:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f27988df700) 00010000:00010000:2.0:1787365203.824303:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787365203.824308:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cce00, rc 0) 00000100:00100000:2.0:1787365203.824384:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+11:9687:x1874188003461760:12345-192.168.203.13@tcp:101:touch.500 Request processed in 312us (515us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365203.824392:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:2.0:1787365203.827905:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365203.828090:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003461888 00000100:00100000:3.0:1787365203.828115:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003461888 00000100:00100000:3.0:1787365203.828171:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:3.0:1787365203.828181:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279809bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1874188003461888:12345-192.168.203.13@tcp:8:touch.500 00010000:00080000:3.0:1787365203.828232:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp t0 exp 0000000000000000 cur 320 last 0 00000020:00000080:3.0:1787365203.828290:0:6681:0:(genops.c:1385:class_connect()) connect: client 8662a6a5-8ae3-4336-8479-3ba18dbc45ca, cookie 0x872d29295eb46e31 00002000:00100000:3.0:1787365203.828306:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8662a6a5-8ae3-4336-8479-3ba18dbc45ca/ffff9f27abe8b800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392e ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787365203.828358:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00010000:00010000:1.0:1787365203.828611:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46e23 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.828649:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46e23 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.828658:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46e23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.828666:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cc600 already unused, calling callback (ffffffffc20b14f0) 00000100:00100000:0.0:1787365203.828668:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024469120:0@lo:13:osp-pre-1-0.0 00010000:00010000:1.0:1787365203.828674:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46e23 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.828685:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46e23 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.828707:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f27988df700) 00010000:00010000:1.0:1787365203.828711:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365203.828717:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46e23 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365203.828723:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46e23 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365203.828746:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365203.828773:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279809ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024469376:0@lo:400:kworker.0 00000100:00100000:1.0:1787365203.828798:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279809b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024469248:0@lo:400:kworker.0 00000100:00100000:2.0:1787365203.828816:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365203.828821:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024469632:0@lo:400:kworker.0 00000100:00100000:2.0:1787365203.828845:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024469888:0@lo:400:kworker.0 00000100:00100000:0.0:1787365203.828859:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365203.828880:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365203.828896:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024469120 00000100:00100000:0.0:1787365203.828902:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024469120 00000100:00100000:2.0:1787365203.828911:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787365203.828914:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365203.828919:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279809b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024469504:0@lo:400:kworker.0 00000100:00100000:2.0:1787365203.828946:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365203.828951:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874188024469760:0@lo:400:kworker.0 00000100:00100000:1.0:1787365203.828976:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365203.828978:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024469376 00000100:00100000:2.0:1787365203.828983:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024469376 00000100:00100000:0.0:1787365203.828983:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787365203.828997:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024469120:12345-0@lo:13:osp-pre-1-0.0 00000100:00080000:1.0:1787365203.829012:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00000024:0.0:1787365203.829019:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365203.829020:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024469504 00000100:00100000:2.0:1787365203.829025:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024469504 00000100:00100000:1.0:1787365203.829027:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024469248 00000100:00100000:1.0:1787365203.829030:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024469248 00000100:00100000:2.0:1787365203.829047:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024469760 00000100:00100000:2.0:1787365203.829049:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024469760 00000100:00100000:1.0:1787365203.829058:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 250 00000100:00100000:2.0:1787365203.829067:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787365203.829073:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024469376:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365203.829073:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3311:x1874188024469248:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365203.829080:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaaea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024469120:12345-0@lo:13:osp-pre-1-0.0 Request processed in 86us (333us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365203.829089:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787365203.829119:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024469632 00000100:00100000:0.0:1787365203.829123:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024469632 00000100:00100000:0.0:1787365203.829149:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024469888 00000100:00100000:0.0:1787365203.829152:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024469888 00000100:00100000:0.0:1787365203.829170:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787365203.829178:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024469632:12345-0@lo:400:kworker.0 00002000:00080000:3.0:1787365203.829232:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00100000:2.0:1787365203.830274:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024469376:12345-0@lo:400:kworker.0 Request processed in 1192us (1449us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365203.830301:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 107 00000100:00100000:2.0:1787365203.830336:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787365203.830346:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024469504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365203.830402:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024469504:12345-0@lo:400:kworker.0 Request processed in 60us (1455us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365203.830408:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 108 00000100:00100000:2.0:1787365203.830418:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787365203.830425:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2686971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874188024469760:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365203.830451:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2686971500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874188024469760:12345-0@lo:400:kworker.0 Request processed in 27us (1475us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365203.830457:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 109 00000100:00100000:2.0:1787365203.831898:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279809b800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024469504:0@lo:400:kworker.0 00000100:00100000:2.0:1787365203.831921:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279809ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024469376:0@lo:400:kworker.0 00000100:00100000:1.0:1787365203.832169:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3311:x1874188024469248:12345-0@lo:400:kworker.0 Request processed in 3095us (3330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365203.832182:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 250 00000100:00080000:1.0:1787365203.832351:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365203.832385:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279809b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024469248:0@lo:400:kworker.0 00000100:00100000:1.0:1787365203.832399:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c2680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874188024469760:0@lo:400:kworker.0 00000100:00100000:0.0:1787365203.832567:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024469632:12345-0@lo:400:kworker.0 Request processed in 3388us (3706us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365203.832578:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787365203.832605:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00080000:3.0:1787365203.832620:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9f27abe8e000 : changing import state from RECOVER to FULL 00000100:00100000:0.0:1787365203.832620:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024469888:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365203.832704:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024469888:12345-0@lo:400:kworker.0 Request processed in 91us (3825us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365203.832731:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:0.0:1787365203.832782:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb3c1880 x1874188024469632/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365203.832794:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024469632:0@lo:400:kworker.0 00010000:00080000:0.0:1787365203.832814:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bbaadf80 x1874188024469120/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365219 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365203.832832:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024469120:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787365203.832921:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279809bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2358:x1874188003461888:12345-192.168.203.13@tcp:8:touch.500 Request processed in 4738us (5031us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365203.832931:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00010000:00080000:1.0:1787365203.833376:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bb3c3100 x1874188024469888/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365219 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365203.833389:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c3100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024469888:0@lo:400:kworker.0 00000100:00100000:1.0:1787365203.835980:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365203.836618:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003462016 00000100:00100000:2.0:1787365203.843353:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003462016 00000100:00100000:2.0:1787365203.843619:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:2.0:1787365203.843649:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2686972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:0:x1874188003462016:12345-192.168.203.13@tcp:2:touch.500 00000100:00080000:1.0:1787365203.844072:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00080000:0.0:1787365203.950697:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967299 is committed 00000001:00100000:0.0:1787365203.950735:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8662a6a5-8ae3-4336-8479-3ba18dbc45ca 00000100:00100000:1.0:1787365203.951008:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2686972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:0:x1874188003462016:12345-192.168.203.13@tcp:2:touch.500 Request processed in 107354us (115034us total) trans 4294967299 rc 0/0 00000100:00100000:1.0:1787365203.951022:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:2.0:1787365203.955503:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365203.955668:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003462272 00000100:00100000:0.0:1787365203.955680:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003462272 00000100:00100000:0.0:1787365203.955739:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:0.0:1787365203.955750:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+10:9687:x1874188003462272:12345-192.168.203.13@tcp:35:touch.500 00000100:00100000:0.0:1787365203.956440:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+11:9687:x1874188003462272:12345-192.168.203.13@tcp:35:touch.500 Request processed in 688us (947us total) trans 4294967302 rc 0/0 00000100:00100000:0.0:1787365203.956450:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:2.0:1787365203.974957:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365203.975084:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003462400 00000100:00100000:0.0:1787365203.975106:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003462400 00000100:00100000:0.0:1787365203.975177:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:0.0:1787365203.975289:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+11:9688:x1874188003462400:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:0.0:1787365203.975323:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365203.975359:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46e38 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988fda expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.975476:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb46e3f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.975495:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb46e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.975511:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb46e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365203.975590:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787365203.975594:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787365203.975695:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb46e3f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.975728:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46e38 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fda expref: 13 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.975749:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb46e3f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fda expref: 12 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.975758:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f27988df200) 00010000:00010000:0.0:1787365203.975761:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787365203.975765:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780031a00, rc 0) 00000100:00100000:0.0:1787365203.975836:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+12:9688:x1874188003462400:12345-192.168.203.13@tcp:101:rm.0 Request processed in 649us (893us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365203.975844:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:2.0:1787365203.993573:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365203.994478:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003462656 00000100:00100000:1.0:1787365203.994494:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003462656 00000100:00100000:0.0:1787365203.994775:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:0.0:1787365203.994787:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+12:9688:x1874188003462656:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:0.0:1787365203.994833:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365203.994861:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46e46 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988fe1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365203.995018:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787365203.995210:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46e46 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fe1 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.995228:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2784761900) 00010000:00010000:0.0:1787365203.995231:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787365203.995236:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46e46 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fe1 expref: 14 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365203.995253:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780031c00, rc 0) 00000100:00100000:0.0:1787365203.995511:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:9688:x1874188003462656:12345-192.168.203.13@tcp:101:rm.0 Request processed in 725us (1951us total) trans 4294967303 rc 301/301 00000100:00100000:0.0:1787365203.995520:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:2.0:1787365204.002761:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365204.002859:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003462784 00000100:00100000:1.0:1787365204.002871:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003462784 00000100:00100000:1.0:1787365204.002995:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:1.0:1787365204.003007:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:9688:x1874188003462784:12345-192.168.203.13@tcp:37:rm.0 00000100:00080000:2.0:1787365204.009211:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365204.015191:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:9688:x1874188003462784:12345-192.168.203.13@tcp:37:rm.0 Request processed in 12162us (12420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365204.015207:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:1.0:1787365204.024394:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365204.024787:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003463040 00000100:00100000:0.0:1787365204.024801:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003463040 00000100:00100000:0.0:1787365204.024909:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:0.0:1787365204.024922:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278ac6fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:9688:x1874188003463040:12345-192.168.203.13@tcp:35:rm.0 00000100:00100000:0.0:1787365204.025413:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278ac6fc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:9688:x1874188003463040:12345-192.168.203.13@tcp:35:rm.0 Request processed in 491us (1030us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787365204.025421:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:2.0:1787365204.028421:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365204.028965:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003463296 00000100:00100000:0.0:1787365204.028978:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003463296 00000100:00100000:0.0:1787365204.029091:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:0.0:1787365204.029169:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:9688:x1874188003463296:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:0.0:1787365204.029256:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365204.029284:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46e54 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988fe8 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.029511:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030600/0x872d29295eb46e5b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.029529:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030600/0x872d29295eb46e5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.029543:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030600/0x872d29295eb46e5b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365204.029555:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:0.0:1787365204.029739:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46e54 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fe8 expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.029765:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030600/0x872d29295eb46e5b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fe8 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.029773:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f27988df200) 00010000:00010000:0.0:1787365204.029777:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787365204.029782:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780030600, rc 0) 00000100:00100000:0.0:1787365204.029931:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+16:9688:x1874188003463296:12345-192.168.203.13@tcp:101:rm.0 Request processed in 764us (1524us total) trans 4294967305 rc 0/0 00000100:00100000:0.0:1787365204.029940:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:2.0:1787365204.033166:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365204.033487:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003463424 00000100:00100000:3.0:1787365204.033500:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003463424 00000100:00100000:3.0:1787365204.033614:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:3.0:1787365204.033723:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+16:9688:x1874188003463424:12345-192.168.203.13@tcp:41:rm.0 00000004:00000024:2.0:1787365204.033880:0:5835:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 7719616512 avail 7715422208 00000100:00100000:2.0:1787365204.033977:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+16:9688:x1874188003463424:12345-192.168.203.13@tcp:41:rm.0 Request processed in 352us (823us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365204.033985:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:2.0:1787365204.040151:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365204.040272:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003463552 00000100:00100000:1.0:1787365204.040285:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003463552 00000100:00100000:1.0:1787365204.040364:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:1.0:1787365204.040381:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279809b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+16:9688:x1874188003463552:12345-192.168.203.13@tcp:101:rm.0 00010000:00010000:1.0:1787365204.040407:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365204.040432:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb46e69 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988fef expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.040671:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46e70 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.040689:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46e70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.040702:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46e70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.040719:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46e77 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.040726:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46e77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.040732:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46e77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.040925:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb46e7e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.040934:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb46e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.040951:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb46e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787365204.040984:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x2:0x0]: returning size 0 00000004:00200000:1.0:1787365204.040989:0:6704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787365204.041010:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb46e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.041023:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb46e7e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.041032:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46e70 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.041039:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46e70 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.041045:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46e70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.041052:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365204.041056:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46e70 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.041063:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46e70 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.041075:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f27988df200) 00010000:00010000:1.0:1787365204.041079:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365204.041084:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46e70 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.041100:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46e70 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.041118:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46e77 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.041124:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46e77 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.041130:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46e77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.041135:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798115600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365204.041138:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46e77 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.041144:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46e77 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.041151:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xda9a1529 (ffff9f2784761e00) 00010000:00010000:1.0:1787365204.041154:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365204.041157:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46e77 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.041163:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46e77 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.041199:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb46e69 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fef expref: 18 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.041213:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb46e7e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fef expref: 17 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.041228:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f27988df700) 00010000:00010000:1.0:1787365204.041231:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787365204.041234:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115e00, rc 0) 00000100:00100000:1.0:1787365204.041310:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279809b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+17:9688:x1874188003463552:12345-192.168.203.13@tcp:101:rm.0 Request processed in 936us (1173us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365204.041319:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:3.0:1787365204.046547:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365204.046819:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003463808 00000100:00100000:0.0:1787365204.046832:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003463808 00000100:00100000:0.0:1787365204.046930:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:0.0:1787365204.046942:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+17:9688:x1874188003463808:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:0.0:1787365204.047013:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787365204.047048:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb46e7e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fef expref: 17 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.047074:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb46e2a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fd3 expref: 16 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.047085:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f27988df700) 00010000:00010000:0.0:1787365204.047104:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb46e3f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fda expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.047115:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f27988df200) 00010000:00010000:0.0:1787365204.047119:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787365204.047147:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46e85 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.047439:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46e85 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.047453:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46e85 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.047539:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031400/0x872d29295eb46e8c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.047548:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031400/0x872d29295eb46e8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.047568:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031400/0x872d29295eb46e8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.048684:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46e93 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.048702:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46e93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.048713:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46e93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787365204.049617:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].2, 64 off8320 00000004:00080000:0.0:1787365204.049692:0:5834:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 321214065605ns, next at 322214061618ns, rc = 0 00010000:00010000:0.0:1787365204.049781:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031800/0x872d29295eb46e9a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.049797:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031800/0x872d29295eb46e9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.049808:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031800/0x872d29295eb46e9a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.049817:0:5834:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031800/0x872d29295eb46e9a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.049825:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031800/0x872d29295eb46e9a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.049831:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031800/0x872d29295eb46e9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.049883:0:5834:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787365204.049914:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46e93 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.049921:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46e93 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.049927:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46e93 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.049933:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365204.049938:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46e93 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.049947:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46e93 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.049960:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:0.0:1787365204.049964:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787365204.049969:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46e93 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.049976:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46e93 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x2:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.049997:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46e85 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.050003:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46e85 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.050009:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46e85 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.050022:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780031c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365204.050025:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46e85 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.050031:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46e85 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.050040:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f27988df200) 00010000:00010000:0.0:1787365204.050043:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365204.050046:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46e85 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.050051:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46e85 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787365204.050061:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000070aacef1 reply state 000000007594d5db transno 4294967306 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031400/0x872d29295eb46e8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365204.050071:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787365204.050188:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+16:9688:x1874188003463808:12345-192.168.203.13@tcp:36:rm.0 Request processed in 3242us (3649us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787365204.050199:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00010000:00010000:2.0:1787365204.051784:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787365204.051799:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031800/0x872d29295eb46e9a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365204.051812:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780031800 already unused, calling callback (ffffffffc1672420) 00010000:00010000:2.0:1787365204.051816:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031800/0x872d29295eb46e9a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365204.051825:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031800/0x872d29295eb46e9a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365204.051843:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x2:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:2.0:1787365204.051846:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:2.0:1787365204.051852:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031800/0x872d29295eb46e9a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365204.051858:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031800/0x872d29295eb46e9a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x2:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365204.051884:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365204.051886:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365204.051888:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365204.054914:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031400/0x872d29295eb46e8c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.054936:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031400/0x872d29295eb46e8c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.054944:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031400/0x872d29295eb46e8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.054973:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780031400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365204.054979:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031400/0x872d29295eb46e8c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.054987:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031400/0x872d29295eb46e8c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.055006:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0xda9a1529 (ffff9f278a0ad200) 00010000:00010000:0.0:1787365204.055009:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365204.055014:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031400/0x872d29295eb46e8c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.055021:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031400/0x872d29295eb46e8c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x1:0x0].0xda9a1529 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365204.063367:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365204.063750:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003464064 00000100:00100000:1.0:1787365204.063762:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003464064 00000100:00100000:1.0:1787365204.063830:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:1.0:1787365204.063841:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+15:9688:x1874188003464064:12345-192.168.203.13@tcp:35:rm.0 00000100:00100000:1.0:1787365204.064281:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+16:9688:x1874188003464064:12345-192.168.203.13@tcp:35:rm.0 Request processed in 441us (927us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787365204.064290:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:2.0:1787365204.067746:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365204.067916:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003464320 00000100:00100000:1.0:1787365204.067928:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003464320 00000100:00100000:1.0:1787365204.068001:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:1.0:1787365204.068012:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279809ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+16:9688:x1874188003464320:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:1.0:1787365204.068092:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787365204.068128:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030600/0x872d29295eb46e5b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x1:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fe8 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.068155:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb46df9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fc5 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.068180:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f27988df200) 00010000:00010000:1.0:1787365204.068230:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114600/0x872d29295eb46dba lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fb7 expref: 14 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.068242:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2784761900) 00010000:00010000:1.0:1787365204.068250:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787365204.068278:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46ea1 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.068293:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46ea1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.068304:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46ea1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.068316:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46ea8 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.068322:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.068329:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.069021:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115400/0x872d29295eb46eaf lrc: 3/0,1 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.069033:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115400/0x872d29295eb46eaf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.069041:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115400/0x872d29295eb46eaf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787365204.070758:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x1:0x0]: returning size 7680 00010000:00010000:1.0:1787365204.070805:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115400/0x872d29295eb46eaf lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.070817:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115400/0x872d29295eb46eaf lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.070825:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115400/0x872d29295eb46eaf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.070832:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798115400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365204.070837:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115400/0x872d29295eb46eaf lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.070847:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115400/0x872d29295eb46eaf lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.070866:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x1:0x0].0x0 (ffff9f2784761b00) 00010000:00010000:1.0:1787365204.070869:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:1.0:1787365204.070876:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115400/0x872d29295eb46eaf lrc: 2/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.070882:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115400/0x872d29295eb46eaf lrc: 0/0,0 mode: --/EX res: [0x200000401:0x1:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.070917:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46ea1 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.070924:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46ea1 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.070930:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46ea1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.070934:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798115600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365204.070943:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46ea1 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.070949:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46ea1 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.070958:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2784761e00) 00010000:00010000:1.0:1787365204.070961:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365204.070964:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46ea1 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365204.070971:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46ea1 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787365204.070985:0:6704:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004f7224dd reply state 00000000cb416dcf transno 4294967308 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365204.070995:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787365204.071192:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279809ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+15:9688:x1874188003464320:12345-192.168.203.13@tcp:36:rm.0 Request processed in 3170us (3450us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787365204.071201:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00010000:00010000:3.0:1787365204.078720:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46ea8 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365204.078746:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46ea8 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365204.078756:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46ea8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365204.078763:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365204.078770:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46ea8 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365204.078780:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46ea8 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365204.078803:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x792b1d9 (ffff9f2784761700) 00010000:00010000:3.0:1787365204.078831:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365204.078838:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46ea8 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365204.078846:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46ea8 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x792b1d9 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365204.338974:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365205.362899:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365206.386968:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365207.409723:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365207.409781:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365207.409817:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365207.409854:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365207.409947:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003464704 00000100:00100000:0.0:1787365207.409956:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003464704 00000100:00100000:0.0:1787365207.410018:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:0.0:1787365207.410030:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279809b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2362:x1874188003464704:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365207.410100:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279809b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2362:x1874188003464704:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 72us (318us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365207.410107:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:0.0:1787365207.410129:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003464576 00000100:00100000:0.0:1787365207.410133:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003464576 00000100:00100000:0.0:1787365207.410159:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003464832 00000100:00100000:0.0:1787365207.410162:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003464832 00000100:00100000:0.0:1787365207.410197:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 110 00000100:00100000:0.0:1787365207.410204:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:2362:x1874188003464576:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365207.410259:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:2362:x1874188003464576:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 43us (430us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365207.410267:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 110 00000100:00100000:0.0:1787365207.410280:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 111 00000100:00100000:0.0:1787365207.410287:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2362:x1874188003464832:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365207.410310:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2362:x1874188003464832:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (456us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365207.410316:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 111 00000100:00080000:2.0:1787365207.410590:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787365207.410596:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787365207.410976:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003464448 00000100:00100000:3.0:1787365207.410983:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003464448 00000100:00100000:3.0:1787365207.411028:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 251 00000100:00100000:3.0:1787365207.411037:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2362:x1874188003464448:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365207.411080:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2362:x1874188003464448:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 45us (1367us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365207.411087:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 251 00010000:00010000:3.0:1787365207.411713:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365207.924942:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024470016:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787365207.925012:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365207.925114:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024470016 00000100:00100000:2.0:1787365207.925121:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024470016 00000100:00100000:2.0:1787365207.925184:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:2.0:1787365207.925195:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024470016:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787365207.925229:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365207.925288:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024470016:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (276us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365207.925295:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00080000:2.0:1787365207.925332:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bf0f7100 x1874188024470016/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365223 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365207.925350:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024470016:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787365207.925458:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:02000400:2.0:1787365208.191036:0:11598:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: excepting tests: 6 7a 7b 23 35 33 00010000:00010000:2.0:1787365208.434902:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365208.946837:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024470400:0@lo:400:kworker.0 00000100:00100000:2.0:1787365208.946929:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365208.947001:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787365208.947008:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024470528:0@lo:400:kworker.0 00000100:00100000:2.0:1787365208.947036:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365208.947077:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024470528 00000100:00100000:2.0:1787365208.947085:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024470528 00000100:00100000:2.0:1787365208.947140:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787365208.947151:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024470528:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365208.947209:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024470528:12345-0@lo:400:kworker.0 Request processed in 60us (172us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365208.947217:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00010000:00080000:2.0:1787365208.947252:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bf0f5f80 x1874188024470528/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365208.947266:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f5f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024470528:0@lo:400:kworker.0 00000100:00100000:3.0:1787365208.947532:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024470144:0@lo:400:kworker.0 00000100:00100000:3.0:1787365208.947565:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365208.950740:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874188024470656:0@lo:400:kworker.0 00000100:00100000:2.0:1787365208.950810:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365208.950852:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787365208.950859:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024470272:0@lo:400:kworker.0 00000100:00100000:2.0:1787365208.950883:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365208.950905:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024470784:0@lo:400:kworker.0 00000100:00100000:2.0:1787365208.950929:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365208.950960:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024470400 00000100:00100000:2.0:1787365208.950966:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024470400 00000100:00100000:2.0:1787365208.951018:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024470656 00000100:00100000:2.0:1787365208.951022:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024470656 00000100:00100000:2.0:1787365208.951037:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024470272 00000100:00100000:2.0:1787365208.951039:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024470272 00000100:00100000:2.0:1787365208.952179:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024470784 00000100:00100000:2.0:1787365208.952186:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024470784 00000100:00100000:2.0:1787365208.952225:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:2.0:1787365208.952235:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024470784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365208.952294:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024470784:12345-0@lo:400:kworker.0 Request processed in 61us (1364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365208.952301:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00080000:2.0:1787365208.952330:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787365208.952334:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365208.952345:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787365208.952352:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024470400:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365208.952388:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024470400:12345-0@lo:400:kworker.0 Request processed in 36us (5461us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365208.952395:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:2.0:1787365208.952408:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787365208.952414:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874188024470656:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365208.952459:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874188024470656:12345-0@lo:400:kworker.0 Request processed in 44us (1649us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365208.952465:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:2.0:1787365208.952478:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 114 00000100:00100000:2.0:1787365208.952485:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024470272:12345-0@lo:400:kworker.0 00000004:00080000:0.0:1787365208.952803:0:8089:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 326117176477ns, next at 327117173975ns, rc = 0 00000100:00100000:1.0:1787365208.953738:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024470144 00000100:00100000:1.0:1787365208.953745:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024470144 00000100:00100000:1.0:1787365208.953786:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 252 00000100:00100000:1.0:1787365208.953794:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024470144:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365208.953844:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024470144:12345-0@lo:400:kworker.0 Request processed in 51us (6277us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365208.953851:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 252 00000100:00100000:2.0:1787365208.954446:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787365208.954464:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024470912:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787365208.954514:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365208.954548:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024470912 00000100:00100000:2.0:1787365208.954552:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024470912 00000100:00100000:2.0:1787365208.954582:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:2.0:1787365208.960416:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024470912:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787365208.960467:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365208.960930:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024470400:0@lo:400:kworker.0 00010000:00080000:1.0:1787365208.960971:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bf0f5c00 x1874188024470784/t0(0) o400->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365224 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365208.960993:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024470784:0@lo:400:kworker.0 00000100:00100000:1.0:1787365208.961007:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024470144:0@lo:400:kworker.0 00000100:00100000:1.0:1787365208.961018:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874188024470656:0@lo:400:kworker.0 00000100:00100000:1.0:1787365208.961097:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbfa300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024470272:12345-0@lo:400:kworker.0 Request processed in 8612us (10212us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365208.961107:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 114 00000100:00100000:1.0:1787365208.961141:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024470272:0@lo:400:kworker.0 00000100:00100000:2.0:1787365208.961510:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024470912:12345-0@lo:13:osp-pre-1-0.0 Request processed in 3086us (6994us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365208.961519:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00010000:00080000:1.0:1787365208.963650:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bbaadf80 x1874188024470912/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365224 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365208.963674:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024470912:0@lo:13:osp-pre-1-0.0 00000001:00080000:0.0:1787365209.013607:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967306 is committed 00000004:00080000:0.0:1787365209.013620:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:0.0:1787365209.013658:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967308 is committed 00000100:00100000:0.0:1787365209.013781:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024471040:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787365209.013848:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365209.013910:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024471040 00000100:00100000:0.0:1787365209.013917:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024471040 00000100:00100000:0.0:1787365209.013958:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787365209.013967:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024471040:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787365209.013991:0:10260:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:2 count 1 00002000:00010000:0.0:1787365209.014023:0:10260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x2:0x0] initial LVB size: 0, mtime: 0x6a890753, atime: 0x6a890753, ctime: 0x6a890753, blocks: 0x1 00010000:00010000:0.0:1787365209.014031:0:10260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3043d1e/0x872d29295eb46eb6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365209.014046:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=326s v=(0 0) 00010000:00010000:0.0:1787365209.014061:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365209.014076:0:10260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3043d1e/0x872d29295eb46eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365209.014093:0:10260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3043d1e/0x872d29295eb46eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365209.014102:0:10260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3043d1e/0x872d29295eb46eb6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365209.014109:0:10260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3043d1e/0x872d29295eb46eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365209.014127:0:10260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787365209.014620:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaae300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1874188024471040:12345-0@lo:6:osp-syn-1-0.0 Request processed in 653us (771us total) trans 4294967300 rc 0/0 00000100:00100000:0.0:1787365209.014649:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00010000:00010000:0.0:1787365209.014674:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365209.014680:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3043d1e/0x872d29295eb46eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365209.014688:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780031800 already unused, calling callback (ffffffffc1672420) 00010000:00010000:0.0:1787365209.014692:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3043d1e/0x872d29295eb46eb6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365209.014700:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3043d1e/0x872d29295eb46eb6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365209.014727:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3043d1e/0x872d29295eb46eb6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365209.014734:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3043d1e/0x872d29295eb46eb6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365209.014751:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365209.014753:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365209.014755:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787365209.014967:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f27bbaaf800/2, rc 0, transno 4294967300 00000100:00100000:2.0:1787365209.014979:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaaf800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024471040:0@lo:6:osp-syn-1-0.0 00000020:00000080:2.0:1787365209.084692:0:11647:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffde23015d0 20000000:00000080:2.0:1787365209.084710:0:11647:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f27b6c0d800 uarg=0000000000000000 20000000:01000000:2.0:1787365209.084746:0:11647:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='lustre' param='mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787365209.084752:0:11647:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'mdt.lustre-MDT0000.hsm_control=enabled' 20000000:01000000:2.0:1787365209.084757:0:11647:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/lustre/mdt.lustre-MDT0000.hsm_control=enabled del=0 00000040:00080000:0.0:1787365209.085536:0:11648:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 7 20000000:02000000:2.0:1787365209.085797:0:11647:0:(mgs_llog.c:4120:mgs_wlp_lcfg()) Setting parameter lustre.mdt.lustre-MDT0000.hsm_control=enabled in log params 00000040:00080000:2.0:1787365209.094562:0:11647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].7, 224 off9536 00000040:00080000:2.0:1787365209.094667:0:11647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].8, 128 off9664 00000040:00080000:2.0:1787365209.094735:0:11647:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x2:0x0].9, 224 off9888 10000000:01000000:2.0:1787365209.094756:0:11647:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787365209.094777:0:11647:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46ebd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365209.094794:0:11647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f2798115c00/0x872d29295eb46d5f lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46d58 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365209.094803:0:11647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f2798114c00/0x872d29295eb46d6d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46d66 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365209.094810:0:11647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f2798115000/0x872d29295eb46d7b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46d74 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365209.094818:0:11647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f2788f45600/0x872d29295eb46d82 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fa2 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365209.094826:0:11647:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f27a12cc800/0x872d29295eb46d89 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fa9 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365209.094833:0:11647:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46ebd lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365209.094880:0:11647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f27a12cc800/0x872d29295eb46d89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fa9 expref: 12 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365209.094896:0:11647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f27a12cc800/0x872d29295eb46d89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fa9 expref: 12 pid: 5829 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365209.094910:0:11647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbfad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874188024471168:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365209.095029:0:11647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f2788f45600/0x872d29295eb46d82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fa2 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365209.095039:0:11647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f2788f45600/0x872d29295eb46d82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fa2 expref: 12 pid: 5827 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365209.095047:0:11647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbf9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874188024471296:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365209.095078:0:11647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f2798115000/0x872d29295eb46d7b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46d74 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365209.095086:0:11647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f2798115000/0x872d29295eb46d7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46d74 expref: 18 pid: 5829 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365209.095094:0:11647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbf8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874188024471424:0@lo:104: 00000100:00100000:2.0:1787365209.095135:0:11647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787365209.097712:0:11647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f2798114c00/0x872d29295eb46d6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46d66 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365209.097730:0:11647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f2798114c00/0x872d29295eb46d6d lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46d66 expref: 18 pid: 5827 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365209.097761:0:11647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbfb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874188024471552:0@lo:104: 00000100:00100000:2.0:1787365209.097807:0:11647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787365209.097838:0:11647:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f2798115c00/0x872d29295eb46d5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb46d58 expref: 18 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365209.097846:0:11647:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 150, AT: on) ns: MGS lock: ffff9f2798115c00/0x872d29295eb46d5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb46d58 expref: 18 pid: 5829 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365209.097855:0:11647:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbf9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874188024471680:0@lo:104: 00000100:00100000:2.0:1787365209.097879:0:11647:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365209.097889:0:11647:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878a5c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787365209.097989:0:5816:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:3.0:1787365209.098003:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024471424 00000100:00100000:3.0:1787365209.098010:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024471424 00000100:00100000:3.0:1787365209.098047:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024471552 00000100:00100000:3.0:1787365209.098050:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024471552 00000100:00100000:3.0:1787365209.098061:0:5816:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024471680 00000100:00100000:3.0:1787365209.098063:0:5816:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024471680 00000100:00100000:3.0:1787365209.098076:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787365209.098084:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbfb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+5:11647:x1874188024471424:12345-0@lo:104: 00010000:00010000:3.0:1787365209.098103:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f2788f45200/0x872d29295eb46d74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46d7b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365209.098171:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:3.0:1787365209.098178:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbfb100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+5:11647:x1874188024471424:12345-0@lo:104: Request processed in 94us (3044us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365209.098185:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787365209.098202:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787365209.098207:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+4:11647:x1874188024471552:12345-0@lo:104: 00010000:00010000:3.0:1787365209.098215:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f2788f45000/0x872d29295eb46d66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46d6d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365209.098248:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:3.0:1787365209.098252:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+4:11647:x1874188024471552:12345-0@lo:104: Request processed in 46us (446us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365209.098258:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787365209.098269:0:5816:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:3.0:1787365209.098275:0:5816:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:11647:x1874188024471680:12345-0@lo:104: 00010000:00010000:3.0:1787365209.098282:0:5816:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f2788f44c00/0x872d29295eb46d58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46d5f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365209.098307:0:5816:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:3.0:1787365209.098312:0:5816:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6e3d050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:65f8cd6c-cad4-438a-a88d-c44efaabba70+3:11647:x1874188024471680:12345-0@lo:104: Request processed in 38us (433us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365209.098317:0:5816:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00010000:00010000:1.0:1787365209.098479:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787365209.098486:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f2788f45200/0x872d29295eb46d74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46d7b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.098493:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45200 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:1.0:1787365209.098496:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f2788f45200/0x872d29295eb46d74 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46d7b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.098504:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f2788f45200/0x872d29295eb46d74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46d7b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787365209.098510:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f2788f45200/0x872d29295eb46d74 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46d7b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365209.098515:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787365209.098559:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f2788f45200/0x872d29295eb46d74 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46d7b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.098566:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787365209.098588:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f2788f45200/0x872d29295eb46d74 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46d7b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.098594:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f2788f45200/0x872d29295eb46d74 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46d7b expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.098606:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787365209.098609:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f2788f45000/0x872d29295eb46d66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46d6d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.098614:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45000 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:1.0:1787365209.098617:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f2788f45000/0x872d29295eb46d66 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46d6d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.098655:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f2788f45000/0x872d29295eb46d66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46d6d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787365209.098662:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f2788f45000/0x872d29295eb46d66 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46d6d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365209.098666:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787365209.098679:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f2788f45000/0x872d29295eb46d66 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46d6d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.098685:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787365209.098691:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f2788f45000/0x872d29295eb46d66 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46d6d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.098706:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f2788f45000/0x872d29295eb46d66 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46d6d expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.098716:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365209.098719:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f2788f44c00/0x872d29295eb46d58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb46d5f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.098725:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44c00 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:1.0:1787365209.098727:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f2788f44c00/0x872d29295eb46d58 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb46d5f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.098734:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f2788f44c00/0x872d29295eb46d58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb46d5f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787365209.098740:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f2788f44c00/0x872d29295eb46d58 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb46d5f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365209.098745:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:1.0:1787365209.098773:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f2788f44c00/0x872d29295eb46d58 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46d5f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.098778:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787365209.098795:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f2788f44c00/0x872d29295eb46d58 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46d5f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.098801:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f2788f44c00/0x872d29295eb46d58 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb46d5f expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.098813:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365209.098820:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365209.098822:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365209.098836:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2686971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024471808:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787365209.098871:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365209.098895:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787365209.098900:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2686970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024471936:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787365209.098920:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365209.098944:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787365209.098952:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024472064:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787365209.098976:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365209.099002:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024471808 00000100:00100000:1.0:1787365209.099006:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024471808 00010000:00010000:1.0:1787365209.099026:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f2798115000/0x872d29295eb46d7b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46d74 expref: 19 pid: 5829 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365209.099044:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024471936 00000100:00100000:1.0:1787365209.099047:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024471936 00010000:00010000:1.0:1787365209.099058:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f2798114c00/0x872d29295eb46d6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46d66 expref: 20 pid: 5827 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365209.099075:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024472064 00000100:00100000:1.0:1787365209.099077:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024472064 00010000:00010000:1.0:1787365209.099087:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f2798115c00/0x872d29295eb46d5f lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46d58 expref: 21 pid: 5829 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365209.099099:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787365209.099105:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65f8cd6c-cad4-438a-a88d-c44efaabba70+21:3310:x1874188024471808:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787365209.099115:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365209.099120:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f2798115000/0x872d29295eb46d7b lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46d74 expref: 21 pid: 5829 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.099135:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f2798115000/0x872d29295eb46d7b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46d74 expref: 21 pid: 5829 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365209.099252:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365209.099267:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787365209.099276:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65f8cd6c-cad4-438a-a88d-c44efaabba70+21:3310:x1874188024471936:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787365209.099285:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365209.099289:0:8434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f2798114c00/0x872d29295eb46d6d lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 10 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46d66 expref: 21 pid: 5827 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365209.099522:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365209.099539:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365209.099577:0:11647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbfad80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874188024471168:192.168.203.13@tcp:104: 00000100:00100000:2.0:1787365209.099587:0:11647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbf9c00 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874188024471296:192.168.203.13@tcp:104: 00000100:00100000:2.0:1787365209.099594:0:11647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbf8380 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874188024471424:0@lo:104: 00000100:00100000:2.0:1787365209.099602:0:11647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbfb480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874188024471552:0@lo:104: 00000100:00100000:2.0:1787365209.099609:0:11647:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbf9180 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:11647:1874188024471680:0@lo:104: 00010000:00010000:0.0:1787365209.099983:0:8434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f2798114c00/0x872d29295eb46d6d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46d66 expref: 21 pid: 5827 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365209.099998:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2798114c00/0x872d29295eb46d6d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 9 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46d66 expref: 21 pid: 5827 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365209.100013:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365209.100346:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b34380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65f8cd6c-cad4-438a-a88d-c44efaabba70+20:3310:x1874188024471936:12345-0@lo:103:ldlm_bl.0 Request processed in 1072us (1424us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365209.100354:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:0.0:1787365209.100383:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003465088 00000100:00100000:0.0:1787365209.100389:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003465088 00010000:00010000:0.0:1787365209.100408:0:8434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f2788f45600/0x872d29295eb46d82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fa2 expref: 13 pid: 5827 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365209.100421:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003464960 00000100:00100000:0.0:1787365209.100423:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003464960 00010000:00010000:0.0:1787365209.100448:0:8434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f27a12cc800/0x872d29295eb46d89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fa9 expref: 14 pid: 5829 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365209.100462:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787365209.100469:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e1a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3313:x1874188024472064:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787365209.100479:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365209.100485:0:8434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f2798115c00/0x872d29295eb46d5f lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb46d58 expref: 19 pid: 5829 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365209.100494:0:8434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f2798115c00/0x872d29295eb46d5f lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb46d58 expref: 19 pid: 5829 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365209.100505:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2798115c00/0x872d29295eb46d5f lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46d58 expref: 19 pid: 5829 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365209.100515:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365209.100547:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e1a050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:3313:x1874188024472064:12345-0@lo:103:ldlm_bl.0 Request processed in 78us (1569us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365209.100553:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:0.0:1787365209.100567:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:0.0:1787365209.100574:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0d7a78e-143d-4100-8e74-6d9e2f230c05+14:2361:x1874188003465088:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787365209.100583:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365209.100592:0:8434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f2788f45600/0x872d29295eb46d82 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fa2 expref: 14 pid: 5827 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365209.100601:0:8434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f2788f45600/0x872d29295eb46d82 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fa2 expref: 14 pid: 5827 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365209.100612:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2788f45600/0x872d29295eb46d82 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fa2 expref: 14 pid: 5827 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365209.100622:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365209.100675:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2361:x1874188003465088:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 102us (1156us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365209.100682:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:0.0:1787365209.100695:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:0.0:1787365209.100702:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0d7a78e-143d-4100-8e74-6d9e2f230c05+12:2361:x1874188003464960:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787365209.100710:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365209.100715:0:8434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f27a12cc800/0x872d29295eb46d89 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fa9 expref: 12 pid: 5829 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365209.100725:0:8434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f27a12cc800/0x872d29295eb46d89 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fa9 expref: 12 pid: 5829 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365209.100735:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a12cc800/0x872d29295eb46d89 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988fa9 expref: 12 pid: 5829 timeout: 426 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365209.100744:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365209.100760:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0d7a78e-143d-4100-8e74-6d9e2f230c05+11:2361:x1874188003464960:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 59us (1221us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365209.100766:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:0.0:1787365209.101759:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024472064:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787365209.102500:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2686970380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024471936:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787365209.103594:0:11647:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46ebd lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.103720:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2798115000/0x872d29295eb46d7b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb46d74 expref: 17 pid: 5829 timeout: 476 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.103739:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46ebd lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.103747:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46ebd lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.103767:0:8435:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46ebd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.103774:0:8435:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46ebd lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.103781:0:8435:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46ebd lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.103789:0:8435:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46ebd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.103795:0:8435:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cc600 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365209.103798:0:8435:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46ebd lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.103806:0:8435:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46ebd lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.103845:0:8435:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46ebd lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.103857:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365209.103932:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b35c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:3310:x1874188024471808:12345-0@lo:103:ldlm_bl.0 Request processed in 4825us (5058us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365209.103942:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:3.0:1787365209.103975:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2686971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024471808:0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787365209.104030:0:11647:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46ebd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365209.104037:0:11647:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46ebd lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365209.104054:0:11647:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a12cc600/0x872d29295eb46ebd lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 11647 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365209.459933:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365210.482776:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787365210.802757:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787365210.802767:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f27882fe000 from 7 10000000:01000000:3.0:1787365210.802772:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787365210.802825:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2788f44000/0x872d29295eb46ec4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365210.802838:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2788f44000/0x872d29295eb46ec4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365210.802849:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2788f44000/0x872d29295eb46ec4 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365210.802874:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024472192:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787365210.802939:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365210.803014:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2784ef1240 going to sleep for 11 seconds 00000100:00100000:1.0:1787365210.803071:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024472192 00000100:00100000:1.0:1787365210.803078:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024472192 00000100:00100000:1.0:1787365210.803144:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 253 00000100:00100000:1.0:1787365210.803154:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:5832:x1874188024472192:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787365210.803167:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365210.803181:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2798115000/0x872d29295eb46ecb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46ec4 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365210.803203:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2798115000/0x872d29295eb46ecb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46ec4 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365210.803215:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2798115000/0x872d29295eb46ecb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46ec4 expref: 17 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365210.803224:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115000, rc 0) 00000100:00100000:1.0:1787365210.803273:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024472192:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 120us (333us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365210.803387:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024472192:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787365210.803403:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2788f44000/0x872d29295eb46ec4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ecb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365210.803411:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2788f44000/0x872d29295eb46ec4 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46ecb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365210.803480:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024472320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365210.803506:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365210.803506:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 253 00000100:00100000:3.0:1787365210.803676:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2784ef1240 going to sleep for 11 seconds 00000100:00100000:1.0:1787365210.809067:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024472320 00000100:00100000:1.0:1787365210.809080:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024472320 00000100:00100000:2.0:1787365210.809315:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 254 00000100:00100000:2.0:1787365210.809327:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024472320:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787365210.809612:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024472320:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 288us (6105us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365210.809620:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 254 00000100:00100000:3.0:1787365210.810953:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024472320:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365210.811011:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024472448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787365210.811095:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365210.811139:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2784ef1240 going to sleep for 11 seconds 00000100:00100000:2.0:1787365210.811895:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024472448 00000100:00100000:2.0:1787365210.811912:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024472448 00000100:00100000:2.0:1787365210.811953:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 255 00000100:00100000:2.0:1787365210.811961:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024472448:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787365210.812166:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024472448:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 204us (1070us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365210.812174:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 255 00000100:00100000:3.0:1787365210.812183:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f1180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024472448:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787365210.814504:0:11660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:11660:1874188024472576:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787365210.814577:0:11660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365210.814751:0:11660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2784ef1c00 going to sleep for 11 seconds 00000100:00100000:2.0:1787365210.814857:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024472576 00000100:00100000:2.0:1787365210.814864:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024472576 00000100:00100000:1.0:1787365210.815004:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 256 00000100:00100000:1.0:1787365210.815016:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:11660:x1874188024472576:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787365210.816230:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:11660:x1874188024472576:12345-0@lo:502:llog_process_th.0 Request processed in 1214us (1651us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365210.816240:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 256 00000100:00100000:3.0:1787365210.816866:0:11660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:11660:1874188024472576:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787365210.816899:0:11660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787365210.816963:0:11660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365210.816965:0:11660:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787365210.816972:0:11660:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f27882fe000 00000020:00000080:3.0:1787365210.816975:0:11660:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:3.0:1787365210.817541:0:11660:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:11660:1874188024472704:0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787365210.817604:0:11660:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365210.817662:0:11660:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2784ef1c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787365210.824301:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024472704 00000100:00100000:0.0:1787365210.824313:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024472704 00000100:00100000:0.0:1787365210.824384:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 257 00000100:00100000:0.0:1787365210.824396:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:11660:x1874188024472704:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787365210.825340:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:11660:x1874188024472704:12345-0@lo:502:llog_process_th.0 Request processed in 943us (7731us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365210.825350:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 257 00000100:00100000:1.0:1787365210.825438:0:11660:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f1180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:11660:1874188024472704:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787365210.825476:0:11660:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787365210.825484:0:11660:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365210.825487:0:11660:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787365210.825491:0:11660:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787365210.825709:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787365210.825725:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787365210.825735:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2788f44000/0x872d29295eb46ec4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ecb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365210.825746:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2788f44000/0x872d29295eb46ec4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ecb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365210.825756:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787365210.825759:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f27a01d6000 from 7 10000000:01000000:0.0:1787365210.825877:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787365210.825979:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46ed2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365210.826253:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46ed2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365210.826266:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46ed2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365210.826288:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024472832:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787365210.826344:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365210.826456:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b690b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365210.826503:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024472832 00000100:00100000:1.0:1787365210.826509:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024472832 00000100:00100000:1.0:1787365210.826550:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 258 00000100:00100000:1.0:1787365210.826559:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:5832:x1874188024472832:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787365210.826572:0:5828:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365210.826585:0:5828:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2798115400/0x872d29295eb46ed9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46ed2 expref: -99 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365210.826610:0:5828:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2798115400/0x872d29295eb46ed9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46ed2 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365210.826662:0:5828:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2798115400/0x872d29295eb46ed9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46ed2 expref: 18 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365210.826684:0:5828:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115400, rc 0) 00000100:00100000:1.0:1787365210.826726:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024472832:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 168us (381us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365210.826735:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 258 00000100:00100000:0.0:1787365210.826751:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024472832:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787365210.826767:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46ed2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ed9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365210.826777:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46ed2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46ed9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365210.826825:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024472960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787365210.826850:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365210.826919:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b690b6c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365210.826955:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024472960 00000100:00100000:1.0:1787365210.826959:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024472960 00000100:00100000:1.0:1787365210.827029:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787365210.827037:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024472960:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787365210.827273:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024472960:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 236us (421us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365210.827291:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaafb80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024472960:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787365210.827325:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbf9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024473088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787365210.827365:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365210.827437:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 259 00000100:00100000:1.0:1787365210.833645:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024473088 00000100:00100000:1.0:1787365210.833659:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024473088 00000100:00100000:1.0:1787365210.833698:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 260 00000100:00100000:1.0:1787365210.833708:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024473088:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787365210.833921:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024473088:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 213us (6554us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365210.833927:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878a5a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787365210.833931:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 260 00000100:00100000:2.0:1787365210.833955:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbf9180 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024473088:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787365210.838077:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6b34380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:11663:1874188024473216:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787365210.838151:0:11663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365210.838186:0:11663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bbb94d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787365210.838303:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024473216 00000100:00100000:0.0:1787365210.838310:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024473216 00000100:00100000:0.0:1787365210.838359:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 261 00000100:00100000:0.0:1787365210.838369:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:11663:x1874188024473216:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787365210.838959:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:11663:x1874188024473216:12345-0@lo:502:llog_process_th.0 Request processed in 590us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365210.838969:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 261 00000040:00080000:3.0:1787365210.844319:0:11664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787365210.845980:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6b34380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:11663:1874188024473216:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787365210.846047:0:11663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787365210.846059:0:11663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365210.846062:0:11663:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787365210.846068:0:11663:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f27a01d6000 00000020:00000080:1.0:1787365210.846072:0:11663:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787365210.846193:0:11663:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6b34380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:11663:1874188024473344:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787365210.846264:0:11663:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365210.846309:0:11663:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bbb94d80 going to sleep for 11 seconds 00000100:00100000:0.0:1787365210.847073:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024473344 00000100:00100000:0.0:1787365210.847081:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024473344 00000100:00100000:0.0:1787365210.847128:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 262 00000100:00100000:0.0:1787365210.847138:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:11663:x1874188024473344:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787365210.847353:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:11663:x1874188024473344:12345-0@lo:502:llog_process_th.0 Request processed in 216us (1088us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365210.847362:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 262 00000100:00100000:1.0:1787365210.847484:0:11663:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6b34380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:11663:1874188024473344:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787365210.847510:0:11663:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787365210.847516:0:11663:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365210.847518:0:11663:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787365210.847522:0:11663:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787365210.847771:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:0.0:1787365210.847791:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787365210.847801:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46ed2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ed9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365210.847812:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46ed2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ed9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365210.847822:0:5832:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:0.0:1787365210.847824:0:5832:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f2797a7c800 from 7 10000000:01000000:0.0:1787365210.847827:0:5832:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:0.0:1787365210.847865:0:5832:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780030c00/0x872d29295eb46ee0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365210.847874:0:5832:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2780030c00/0x872d29295eb46ee0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365210.847882:0:5832:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2780030c00/0x872d29295eb46ee0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365210.847899:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024473472:0@lo:101:ll_cfg_requeue.0 00000100:00100000:0.0:1787365210.847933:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365210.847958:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b690b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787365210.847972:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024473472 00000100:00100000:0.0:1787365210.847976:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024473472 00000100:00100000:0.0:1787365210.848002:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787365210.848009:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:5832:x1874188024473472:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787365210.848019:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365210.848031:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2780030400/0x872d29295eb46ee7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb46ee0 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365210.848065:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2780030400/0x872d29295eb46ee7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb46ee0 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365210.848076:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2780030400/0x872d29295eb46ee7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb46ee0 expref: 19 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365210.848084:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780030400, rc 0) 00000100:00100000:0.0:1787365210.848117:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e3c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:5832:x1874188024473472:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 108us (183us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365210.848123:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 263 00000100:00100000:0.0:1787365210.848153:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024473472:0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787365210.848165:0:5832:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2780030c00/0x872d29295eb46ee0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ee7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365210.848172:0:5832:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2780030c00/0x872d29295eb46ee0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46ee7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365210.848212:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024473600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787365210.848236:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365210.848250:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b690b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787365210.848262:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024473600 00000100:00100000:0.0:1787365210.848264:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024473600 00000100:00100000:0.0:1787365210.848284:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787365210.848290:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:5832:x1874188024473600:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787365210.848499:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e1050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:5832:x1874188024473600:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 208us (261us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365210.848516:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 264 00000100:00100000:0.0:1787365210.848547:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024473600:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787365210.848571:0:5832:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024473728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787365210.848604:0:5832:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365210.848653:0:5832:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b690b240 going to sleep for 11 seconds 00000100:00100000:0.0:1787365210.848665:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024473728 00000100:00100000:0.0:1787365210.848668:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024473728 00000100:00100000:0.0:1787365210.848687:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787365210.848703:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:5832:x1874188024473728:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787365210.848816:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e2450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:5832:x1874188024473728:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 123us (211us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365210.848823:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 265 00000100:00100000:0.0:1787365210.848859:0:5832:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaad500 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:65f8cd6c-cad4-438a-a88d-c44efaabba70:5832:1874188024473728:0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787365210.851977:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6b34380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:11665:1874188024473856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787365210.852046:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365210.852117:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bbb946c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365210.855212:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024473856 00000100:00100000:3.0:1787365210.855225:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024473856 00000100:00100000:3.0:1787365210.855327:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 266 00000100:00100000:3.0:1787365210.855339:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:11665:x1874188024473856:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787365210.855604:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:11665:x1874188024473856:12345-0@lo:502:llog_process_th.0 Request processed in 267us (3556us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365210.855612:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 266 00000100:00100000:2.0:1787365210.856893:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6b34380 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:11665:1874188024473856:0@lo:502:llog_process_th.0 00000020:01000000:2.0:1787365210.856931:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:2.0:1787365210.856945:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365210.856948:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:2.0:1787365210.856955:0:11665:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f2797a7c800 00000020:00000080:2.0:1787365210.856958:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:2.0:1787365210.857379:0:11665:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbf9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:11665:1874188024473984:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787365210.857445:0:11665:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365210.858941:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024473984 00000100:00100000:1.0:1787365210.858952:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024473984 00000100:00100000:1.0:1787365210.858995:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 267 00000100:00100000:1.0:1787365210.859004:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:11665:x1874188024473984:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787365210.859236:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e1850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:11665:x1874188024473984:12345-0@lo:502:llog_process_th.0 Request processed in 232us (1791us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365210.859245:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 267 00000100:00100000:3.0:1787365210.869017:0:11665:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878a5a80 going to sleep for 11 seconds 00000100:00100000:3.0:1787365210.869056:0:11665:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbf9180 pname:cluuid:pid:xid:nid:opc:job llog_process_th:65f8cd6c-cad4-438a-a88d-c44efaabba70:11665:1874188024473984:0@lo:502:llog_process_th.0 00000020:01000000:3.0:1787365210.869106:0:11665:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787365210.869114:0:11665:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365210.869116:0:11665:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787365210.869121:0:11665:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:3.0:1787365210.869187:0:5832:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 7-9 (rc=0) 10000000:01000000:3.0:1787365210.869206:0:5832:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787365210.869216:0:5832:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780030c00/0x872d29295eb46ee0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ee7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365210.869226:0:5832:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2780030c00/0x872d29295eb46ee0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ee7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365211.063318:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365211.063430:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003465216 00000100:00100000:0.0:1787365211.063438:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003465216 00000100:00100000:0.0:1787365211.063591:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 268 00000100:00100000:0.0:1787365211.063602:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+11:5599:x1874188003465216:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787365211.063619:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365211.063654:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2780031800/0x872d29295eb46eee lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988ff6 expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365211.063681:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2780031800/0x872d29295eb46eee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ff6 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365211.063692:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2780031800/0x872d29295eb46eee lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ff6 expref: 12 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365211.063712:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780031800, rc 0) 00000100:00100000:0.0:1787365211.063821:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e3450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+12:5599:x1874188003465216:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 221us (512us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365211.063828:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 268 00000100:00100000:0.0:1787365211.075879:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365211.078072:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003465344 00000100:00100000:2.0:1787365211.078086:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003465344 00000100:00100000:2.0:1787365211.078330:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 269 00000100:00100000:2.0:1787365211.078341:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+12:5599:x1874188003465344:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787365211.078784:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e3050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+12:5599:x1874188003465344:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 444us (2912us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365211.078793:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 269 00000100:00100000:2.0:1787365211.083496:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365211.085519:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003465472 00000100:00100000:3.0:1787365211.085531:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003465472 00000100:00100000:3.0:1787365211.085584:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 270 00000100:00100000:3.0:1787365211.085592:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+12:5599:x1874188003465472:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787365211.086003:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e1c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+12:5599:x1874188003465472:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 410us (2515us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365211.086011:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 270 00000100:00100000:1.0:1787365211.101301:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365211.101428:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003465600 00000100:00100000:2.0:1787365211.101439:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003465600 00000100:00100000:2.0:1787365211.101507:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 271 00000100:00100000:2.0:1787365211.101525:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+12:9958:x1874188003465600:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787365211.102127:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e0850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+12:9958:x1874188003465600:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 609us (834us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365211.102136:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 271 00000100:00100000:0.0:1787365211.119111:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365211.119398:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003465728 00000100:00100000:3.0:1787365211.119407:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003465728 00000100:00100000:3.0:1787365211.119479:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 272 00000100:00100000:3.0:1787365211.119490:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+12:9958:x1874188003465728:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787365211.120415:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e3850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+12:9958:x1874188003465728:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 921us (1309us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365211.120434:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 272 00000100:00100000:3.0:1787365211.126675:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365211.126998:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003465856 00000100:00100000:0.0:1787365211.127008:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003465856 00000100:00100000:0.0:1787365211.127074:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 273 00000100:00100000:0.0:1787365211.127084:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+12:5599:x1874188003465856:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787365211.127101:0:5827:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365211.127118:0:5827:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2780031400/0x872d29295eb46ef5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98988ffd expref: -99 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365211.127157:0:5827:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2780031400/0x872d29295eb46ef5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ffd expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365211.127169:0:5827:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2780031400/0x872d29295eb46ef5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ffd expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365211.127177:0:5827:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780031400, rc 0) 00000100:00100000:0.0:1787365211.127244:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e2050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:5599:x1874188003465856:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 161us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365211.127251:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 273 00000100:00100000:1.0:1787365211.134441:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365211.134961:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003465984 00000100:00100000:3.0:1787365211.134972:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003465984 00000100:00100000:3.0:1787365211.135557:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 274 00000100:00100000:3.0:1787365211.135569:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:5599:x1874188003465984:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365211.135898:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e2c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:5599:x1874188003465984:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 332us (1467us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365211.135907:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 274 00000100:00100000:1.0:1787365211.140381:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365211.140478:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003466112 00000100:00100000:2.0:1787365211.140486:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003466112 00000100:00100000:2.0:1787365211.140563:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 275 00000100:00100000:2.0:1787365211.140572:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:5599:x1874188003466112:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787365211.140783:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e0050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:5599:x1874188003466112:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 212us (409us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365211.140796:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 275 00000100:00100000:2.0:1787365211.155391:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365211.156693:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003466240 00000100:00100000:3.0:1787365211.156706:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003466240 00000100:00100000:3.0:1787365211.156757:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 276 00000100:00100000:3.0:1787365211.156766:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:9961:x1874188003466240:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787365211.157018:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e0c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:9961:x1874188003466240:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 252us (1635us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365211.157027:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 276 00000100:00100000:1.0:1787365211.161493:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365211.161728:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003466368 00000100:00100000:2.0:1787365211.161737:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003466368 00000100:00100000:2.0:1787365211.161792:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 277 00000100:00100000:2.0:1787365211.161802:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:9961:x1874188003466368:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787365211.164487:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e1450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:9961:x1874188003466368:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 2675us (2992us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365211.164501:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 277 00010000:00010000:1.0:1787365211.507389:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787365211.892243:0:11664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:0.0:1787365212.530852:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365212.530877:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365212.530925:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365212.530955:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365212.530996:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365212.531081:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003466624 00000100:00100000:3.0:1787365212.531090:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003466624 00000100:00100000:3.0:1787365212.531148:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003466880 00000100:00100000:3.0:1787365212.531151:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003466880 00000100:00100000:3.0:1787365212.531174:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:3.0:1787365212.531183:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2361:x1874188003466624:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365212.531251:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b35c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2361:x1874188003466624:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 69us (326us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365212.531258:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:3.0:1787365212.531274:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:3.0:1787365212.531280:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2361:x1874188003466880:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365212.531321:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b37100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2361:x1874188003466880:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 41us (365us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365212.531327:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00080000:1.0:1787365212.531601:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365212.531794:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003466496 00000100:00100000:0.0:1787365212.531805:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003466496 00000100:00100000:0.0:1787365212.531842:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 278 00000100:00100000:0.0:1787365212.531849:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2362:x1874188003466496:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365212.531891:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883e2850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2362:x1874188003466496:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 41us (1020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365212.531898:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 278 00000100:00100000:2.0:1787365212.532127:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003466752 00000100:00100000:2.0:1787365212.532132:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003466752 00000100:00100000:2.0:1787365212.532183:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:2.0:1787365212.532192:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2361:x1874188003466752:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1787365212.532224:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2361:x1874188003466752:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 35us (1228us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365212.532232:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00080000:1.0:1787365212.532643:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787365213.043346:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024474112:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787365213.043524:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365213.043647:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024474112 00000100:00100000:0.0:1787365213.043654:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024474112 00000100:00100000:0.0:1787365213.043710:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:0.0:1787365213.043719:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024474112:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787365213.043751:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787365213.043794:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b35880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024474112:12345-0@lo:13:osp-pre-0-0.0 Request processed in 76us (270us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365213.043801:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000100:00080000:1.0:1787365213.043968:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:1.0:1787365213.043997:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bbaad500 x1874188024474112/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365229 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365213.044014:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaad500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024474112:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787365213.554905:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365214.066840:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024474240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365214.066912:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365214.066963:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024474240 00000100:00100000:2.0:1787365214.066972:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024474240 00000100:00100000:3.0:1787365214.067059:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787365214.067071:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874188024474240:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787365214.067103:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365214.067150:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b35180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874188024474240:12345-0@lo:13:osp-pre-1-0.0 Request processed in 81us (238us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365214.067156:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00080000:3.0:1787365214.067239:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787365214.067501:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaaed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024474240:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365214.067516:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787365214.067521:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024474368:0@lo:400:kworker.0 00000100:00100000:1.0:1787365214.067756:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365214.069122:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024474368 00000100:00100000:3.0:1787365214.069132:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024474368 00000100:00100000:3.0:1787365214.069174:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 279 00000100:00100000:3.0:1787365214.069182:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024474368:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365214.069249:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b6050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024474368:12345-0@lo:400:kworker.0 Request processed in 68us (1492us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365214.069256:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 279 00000100:00100000:1.0:1787365214.069873:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024474368:0@lo:400:kworker.0 00000100:00100000:0.0:1787365214.074879:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787365214.074905:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874188024474496:0@lo:400:kworker.0 00000100:00100000:0.0:1787365214.074969:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365214.075018:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024474496 00000100:00100000:0.0:1787365214.075025:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024474496 00000100:00100000:0.0:1787365214.075069:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787365214.075078:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874188024474496:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365214.075134:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaaf100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874188024474496:12345-0@lo:400:kworker.0 Request processed in 58us (164us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365214.075142:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:0.0:1787365214.075182:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874188024474496:0@lo:400:kworker.0 00000100:00100000:0.0:1787365214.075341:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874188024474624:0@lo:400:kworker.0 00000100:00100000:0.0:1787365214.075378:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365214.075421:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024474752:0@lo:400:kworker.0 00000100:00100000:0.0:1787365214.075449:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365214.075469:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787365214.075475:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874188024474880:0@lo:400:kworker.0 00000100:00100000:0.0:1787365214.075499:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365214.075534:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024474624 00000100:00100000:0.0:1787365214.075537:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024474624 00000100:00100000:0.0:1787365214.075569:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024474880 00000100:00100000:0.0:1787365214.075572:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024474880 00000100:00100000:0.0:1787365214.075592:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787365214.075600:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874188024474624:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365214.075673:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaaed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3313:x1874188024474624:12345-0@lo:400:kworker.0 Request processed in 74us (294us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365214.075681:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787365214.075703:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787365214.075712:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874188024474880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365214.075750:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaafb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874188024474880:12345-0@lo:400:kworker.0 Request processed in 41us (250us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365214.075757:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787365214.075782:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024474752 00000100:00100000:0.0:1787365214.075786:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024474752 00000100:00100000:0.0:1787365214.075818:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787365214.075831:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024474752:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365214.075866:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaad500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024474752:12345-0@lo:400:kworker.0 Request processed in 42us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365214.075872:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00080000:0.0:1787365214.075902:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365214.075952:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0000_UUID:3313:1874188024474624:0@lo:400:kworker.0 00000100:00100000:0.0:1787365214.075981:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874188024474880:0@lo:400:kworker.0 00010000:00080000:0.0:1787365214.075997:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bbaaf480 x1874188024474752/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365230 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365214.076009:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024474752:0@lo:400:kworker.0 00000001:00080000:3.0:1787365214.122895:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967300 is committed 00000004:00080000:1.0:1787365214.129592:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 3 committed 00010000:00010000:0.0:1787365214.579049:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365215.603165:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365216.626950:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365217.650929:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365217.652427:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365217.652516:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365217.656197:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365217.656240:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365217.656441:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003467264 00000100:00100000:1.0:1787365217.656451:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003467264 00000100:00100000:1.0:1787365217.656510:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:1.0:1787365217.656520:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2360:x1874188003467264:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365217.656590:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2360:x1874188003467264:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 71us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365217.656609:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00080000:1.0:1787365217.656647:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787365217.657283:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003467008 00000100:00100000:3.0:1787365217.657288:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003467008 00000100:00100000:3.0:1787365217.657320:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 280 00000100:00100000:3.0:1787365217.657327:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2360:x1874188003467008:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365217.657367:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b6c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2360:x1874188003467008:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 40us (1180us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365217.657395:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 280 00000100:00100000:0.0:1787365217.662204:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003467136 00000100:00100000:0.0:1787365217.662217:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003467136 00000100:00100000:0.0:1787365217.662307:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003467392 00000100:00100000:0.0:1787365217.662310:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003467392 00000100:00100000:0.0:1787365217.662344:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:0.0:1787365217.662354:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2360:x1874188003467136:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365217.662439:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b34e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2360:x1874188003467136:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 86us (10020us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365217.662446:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:0.0:1787365217.662464:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:0.0:1787365217.662470:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2360:x1874188003467392:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365217.662495:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b34a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2360:x1874188003467392:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 26us (9980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365217.662502:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00080000:1.0:1787365217.662693:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365218.163307:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024475008:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787365218.163383:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365218.163515:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024475008 00000100:00100000:3.0:1787365218.163523:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024475008 00000100:00100000:3.0:1787365218.163581:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:3.0:1787365218.163590:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024475008:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787365218.163623:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365218.163687:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024475008:12345-0@lo:13:osp-pre-0-0.0 Request processed in 98us (303us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365218.163694:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00010000:00080000:3.0:1787365218.163725:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bbaaf480 x1874188024475008/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365234 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365218.163742:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024475008:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787365218.164073:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787365218.674884:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365219.187385:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024475136:0@lo:400:kworker.0 00000100:00100000:0.0:1787365219.187417:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024475648:0@lo:400:kworker.0 00000100:00100000:1.0:1787365219.187454:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365219.187457:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365219.187514:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787365219.187520:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024475776:0@lo:400:kworker.0 00000100:00100000:2.0:1787365219.187521:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024475136 00000100:00100000:2.0:1787365219.187528:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024475136 00000100:00100000:3.0:1787365219.187746:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024475520:0@lo:400:kworker.0 00000100:00100000:2.0:1787365219.187825:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 281 00000100:00100000:2.0:1787365219.187835:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3313:x1874188024475136:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365219.197789:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024475264:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365219.197874:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365219.197966:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024475648 00000100:00100000:1.0:1787365219.197979:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024475648 00000100:00100000:1.0:1787365219.198024:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787365219.198032:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024475648:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365219.198081:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024475648:12345-0@lo:400:kworker.0 Request processed in 50us (10623us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365219.198088:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787365219.198391:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024475392:0@lo:400:kworker.0 00000100:00100000:1.0:1787365219.198422:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365219.198440:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024475904:0@lo:400:kworker.0 00000100:00100000:1.0:1787365219.198473:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365219.198508:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024475904 00000100:00100000:1.0:1787365219.198512:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024475904 00000100:00100000:1.0:1787365219.198541:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787365219.198547:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024475904:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365219.198580:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b36680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024475904:12345-0@lo:400:kworker.0 Request processed in 32us (119us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365219.198585:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:1.0:1787365219.198650:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967300 gen 2 00000004:00080000:1.0:1787365219.198655:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f27bbaaf800, transno 4294967300 00000100:00100000:1.0:1787365219.198668:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaad180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024475904:0@lo:400:kworker.0 00000100:00080000:1.0:1787365219.198694:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787365219.198705:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024475392 00000100:00100000:1.0:1787365219.198708:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024475392 00000100:00100000:1.0:1787365219.198733:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787365219.198740:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024475392:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365219.198775:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b36a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024475392:12345-0@lo:400:kworker.0 Request processed in 36us (352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365219.198781:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:1.0:1787365219.198806:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaac380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024475392:0@lo:400:kworker.0 00000100:00100000:1.0:1787365219.199130:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024475264 00000100:00100000:1.0:1787365219.199135:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024475264 00000100:00100000:1.0:1787365219.199160:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787365219.199166:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024475264:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787365219.199187:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365219.199225:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b35f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024475264:12345-0@lo:13:osp-pre-1-0.0 Request processed in 59us (1352us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365219.199231:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:1.0:1787365219.199259:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6b34000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024475264:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787365219.209447:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365219.209494:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024475776 00000100:00100000:0.0:1787365219.209503:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024475776 00010000:00080000:1.0:1787365219.209547:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bbaaca80 x1874188024475648/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365235 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365219.209557:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787365219.209563:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024475648:0@lo:400:kworker.0 00000100:00100000:0.0:1787365219.209568:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024475776:12345-0@lo:400:kworker.0 00000100:00080000:1.0:1787365219.209592:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365219.209652:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaaf800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024475776:12345-0@lo:400:kworker.0 Request processed in 86us (209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365219.209659:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 123 00000100:00100000:1.0:1787365219.209663:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024475776:0@lo:400:kworker.0 00000100:00100000:3.0:1787365219.213315:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365219.213383:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024475520 00000100:00100000:1.0:1787365219.213394:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024475520 00000100:00100000:1.0:1787365219.213472:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:1.0:1787365219.213481:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024475520:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365219.213550:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024475520:12345-0@lo:400:kworker.0 Request processed in 70us (241us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365219.213557:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:0.0:1787365219.213616:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024475520:0@lo:400:kworker.0 00000100:00080000:3.0:1787365219.213932:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365219.214912:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b4050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3313:x1874188024475136:12345-0@lo:400:kworker.0 Request processed in 27073us (27452us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365219.214923:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 281 00000100:00100000:1.0:1787365219.218438:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaadc00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024475136:0@lo:400:kworker.0 00010000:00010000:3.0:1787365219.699102:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365220.723305:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787365221.107296:0:11664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787365221.747034:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365222.770876:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365222.771025:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365222.771070:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365222.771115:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365222.771151:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365222.771186:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003467776 00000100:00100000:3.0:1787365222.771198:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003467520 00000100:00100000:1.0:1787365222.771198:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003467776 00000100:00100000:3.0:1787365222.771211:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003467520 00000100:00100000:1.0:1787365222.771296:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:3.0:1787365222.771305:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 282 00000100:00100000:1.0:1787365222.771314:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2360:x1874188003467776:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365222.771323:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2360:x1874188003467520:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365222.771408:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b36300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2360:x1874188003467776:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 100us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365222.771411:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b4c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2360:x1874188003467520:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 92us (292us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365222.771431:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:3.0:1787365222.771433:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 282 00000100:00080000:3.0:1787365222.771486:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787365222.771569:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003467648 00000100:00100000:0.0:1787365222.771576:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003467648 00000100:00100000:2.0:1787365222.772027:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003467904 00000100:00100000:2.0:1787365222.772032:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003467904 00000100:00100000:0.0:1787365222.779101:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:0.0:1787365222.779131:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2360:x1874188003467648:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365222.779222:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b34000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2360:x1874188003467648:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 109us (8202us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365222.779229:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:2.0:1787365222.779570:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00100000:2.0:1787365222.779578:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2360:x1874188003467904:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1787365222.779610:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b37800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2360:x1874188003467904:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 33us (8539us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365222.779617:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00080000:2.0:1787365222.779657:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365223.283022:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787365223.284663:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024476032:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787365223.284744:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365223.284947:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024476032 00000100:00100000:3.0:1787365223.284955:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024476032 00000100:00100000:3.0:1787365223.285030:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787365223.285043:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024476032:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787365223.285189:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365223.285246:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b37b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024476032:12345-0@lo:13:osp-pre-0-0.0 Request processed in 204us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365223.285255:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00080000:0.0:1787365223.285419:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787365223.285536:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bbaace00 x1874188024476032/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365239 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365223.285556:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaace00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024476032:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787365223.795847:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365224.308933:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024476160:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365224.309004:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365224.309115:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024476160 00000100:00100000:3.0:1787365224.309123:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024476160 00000100:00100000:3.0:1787365224.309399:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787365224.309411:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024476160:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787365224.309440:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365224.309484:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b35500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024476160:12345-0@lo:13:osp-pre-1-0.0 Request processed in 76us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365224.309493:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787365224.309522:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279808c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024476544:0@lo:400:kworker.0 00000100:00100000:3.0:1787365224.309556:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365224.309584:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787365224.309593:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024476416:0@lo:400:kworker.0 00000100:00100000:3.0:1787365224.309621:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365224.309986:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024476544 00000100:00100000:3.0:1787365224.309991:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024476544 00000100:00100000:3.0:1787365224.310030:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024476416 00000100:00100000:3.0:1787365224.310034:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024476416 00000100:00100000:3.0:1787365224.310061:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787365224.310070:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024476544:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365224.310124:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024476544:12345-0@lo:400:kworker.0 Request processed in 56us (569us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365224.310133:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 127 00000100:00100000:3.0:1787365224.310155:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787365224.310178:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024476416:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365224.310221:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024476416:12345-0@lo:400:kworker.0 Request processed in 59us (600us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365224.310229:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 128 00000100:00100000:3.0:1787365224.310276:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024476416:0@lo:400:kworker.0 00000100:00100000:3.0:1787365224.310294:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279808c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024476544:0@lo:400:kworker.0 00000100:00100000:3.0:1787365224.310515:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024476288:0@lo:400:kworker.0 00000100:00100000:3.0:1787365224.310547:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365224.310578:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279808df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024476800:0@lo:400:kworker.0 00000100:00100000:3.0:1787365224.310598:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365224.310616:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787365224.310622:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279808c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024476672:0@lo:400:kworker.0 00000100:00100000:3.0:1787365224.310667:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365224.310707:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024476160:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787365224.310779:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024476800 00000100:00100000:3.0:1787365224.310784:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024476800 00000100:00100000:3.0:1787365224.310810:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787365224.310817:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024476800:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365224.310852:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024476800:12345-0@lo:400:kworker.0 Request processed in 35us (253us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365224.310868:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 129 00000100:00100000:3.0:1787365224.310896:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279808df80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024476800:0@lo:400:kworker.0 00000100:00100000:3.0:1787365224.310921:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024476288 00000100:00100000:3.0:1787365224.310925:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024476288 00000100:00100000:3.0:1787365224.310949:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787365224.310955:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3313:x1874188024476288:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365224.310988:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b5450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3313:x1874188024476288:12345-0@lo:400:kworker.0 Request processed in 32us (440us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365224.310994:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 283 00000100:00100000:3.0:1787365224.311022:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024476288:0@lo:400:kworker.0 00000100:00080000:3.0:1787365224.311969:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787365224.311975:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787365224.315294:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024476672 00000100:00100000:1.0:1787365224.315317:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024476672 00000100:00100000:1.0:1787365224.315399:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787365224.315412:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024476672:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365224.315509:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f1180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024476672:12345-0@lo:400:kworker.0 Request processed in 101us (4840us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365224.315518:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00080000:0.0:1787365224.316003:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f279808c000 x1874188024476672/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365240 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365224.316019:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279808c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024476672:0@lo:400:kworker.0 00010000:00010000:0.0:1787365224.818948:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365225.842904:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365226.866778:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365227.891093:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365227.893461:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365227.893508:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365227.893668:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003468032 00000100:00100000:3.0:1787365227.893678:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003468032 00000100:00100000:3.0:1787365227.893740:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 284 00000100:00100000:3.0:1787365227.893751:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2362:x1874188003468032:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365227.893814:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b6850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2362:x1874188003468032:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 65us (362us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365227.893822:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 284 00000100:00100000:0.0:1787365227.894066:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003468160 00000100:00100000:0.0:1787365227.894071:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003468160 00000100:00100000:0.0:1787365227.894128:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 130 00000100:00100000:0.0:1787365227.894138:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2362:x1874188003468160:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365227.894169:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2362:x1874188003468160:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 34us (662us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365227.894176:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 130 00000100:00080000:3.0:1787365227.894243:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365227.905756:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365227.905804:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365227.905949:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003468416 00000100:00100000:3.0:1787365227.905959:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003468416 00000100:00100000:3.0:1787365227.906037:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 131 00000100:00100000:3.0:1787365227.906047:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2362:x1874188003468416:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365227.906132:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaac380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2362:x1874188003468416:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 87us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365227.906141:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 131 00000100:00080000:0.0:1787365227.906242:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365227.906298:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003468288 00000100:00100000:1.0:1787365227.906311:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003468288 00000100:00100000:1.0:1787365227.906367:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1787365227.906375:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2358:x1874188003468288:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:1.0:1787365227.906395:0:10260:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46e31 00000100:00080000:0.0:1787365227.906645:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787365227.906692:0:10260:0:(import.c:65:import_set_state_nolock()) ffff9f27abe8e000 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787365227.906750:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00000004:1.0:1787365227.908880:0:10260:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967300 00000100:00100000:1.0:1787365227.909212:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+2:2358:x1874188003468288:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 2832us (3402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365227.909224:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1787365228.402967:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787365228.403002:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024476928:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787365228.403110:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365228.408676:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024476928 00000100:00100000:2.0:1787365228.408697:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024476928 00000100:00100000:2.0:1787365228.408953:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:2.0:1787365228.408967:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024476928:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787365228.409968:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365228.410110:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024476928:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1143us (6996us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365228.410122:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00010000:00080000:1.0:1787365228.410308:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bbaaf480 x1874188024476928/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365244 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365228.410338:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaaf480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024476928:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787365228.414188:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787365228.915278:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365229.430440:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787365229.434223:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024477184:0@lo:400:kworker.0 00000100:00100000:1.0:1787365229.434304:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365229.434361:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787365229.434368:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024477312:0@lo:400:kworker.0 00000100:00100000:1.0:1787365229.434396:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365229.434435:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024477184 00000100:00100000:1.0:1787365229.434442:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024477184 00000100:00100000:1.0:1787365229.434487:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787365229.434495:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024477184:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365229.434544:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b7c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024477184:12345-0@lo:400:kworker.0 Request processed in 50us (250us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365229.434551:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 285 00000100:00100000:1.0:1787365229.434595:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f0a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024477184:0@lo:400:kworker.0 00000100:00100000:1.0:1787365229.434689:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024477312 00000100:00100000:1.0:1787365229.434694:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024477312 00000100:00100000:1.0:1787365229.434723:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787365229.434730:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024477312:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365229.434767:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024477312:12345-0@lo:400:kworker.0 Request processed in 38us (370us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365229.434773:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 132 00000100:00100000:1.0:1787365229.434802:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6b34380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024477312:0@lo:400:kworker.0 00000100:00100000:0.0:1787365229.436828:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024477440:0@lo:400:kworker.0 00000100:00100000:0.0:1787365229.436882:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365229.436909:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024477056:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787365229.436932:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365229.437690:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024477056 00000100:00100000:0.0:1787365229.437699:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024477056 00000100:00100000:0.0:1787365229.437760:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787365229.437767:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024477056:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787365229.437794:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787365229.437838:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024477056:12345-0@lo:13:osp-pre-1-0.0 Request processed in 71us (905us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365229.437845:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787365229.437863:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024477440 00000100:00100000:0.0:1787365229.437874:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024477440 00000100:00100000:0.0:1787365229.437898:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 133 00000100:00100000:0.0:1787365229.437904:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024477440:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365229.437937:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaaf480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024477440:12345-0@lo:400:kworker.0 Request processed in 33us (1054us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365229.437943:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 133 00000100:00080000:0.0:1787365229.437956:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787365229.437960:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787365229.438690:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6b36d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024477440:0@lo:400:kworker.0 00000100:00100000:1.0:1787365229.438710:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbf8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024477056:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787365229.440671:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024477696:0@lo:400:kworker.0 00000100:00100000:2.0:1787365229.440736:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365229.440783:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024477696 00000100:00100000:2.0:1787365229.440789:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024477696 00000100:00100000:2.0:1787365229.440833:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787365229.440840:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024477696:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365229.440878:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024477696:12345-0@lo:400:kworker.0 Request processed in 39us (142us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365229.440885:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 134 00000100:00100000:2.0:1787365229.440922:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbfad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024477696:0@lo:400:kworker.0 00000100:00080000:0.0:1787365229.441313:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365229.441324:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024477568:0@lo:400:kworker.0 00000100:00100000:0.0:1787365229.441354:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365229.442595:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024477568 00000100:00100000:1.0:1787365229.442604:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024477568 00000100:00100000:1.0:1787365229.442686:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787365229.442696:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024477568:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365229.442762:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024477568:12345-0@lo:400:kworker.0 Request processed in 69us (1407us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365229.442769:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00010000:00080000:1.0:1787365229.442833:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bbbf9c00 x1874188024477568/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365245 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365229.442846:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbf9c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024477568:0@lo:400:kworker.0 00000001:00100000:3.0:1787365229.483496:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8662a6a5-8ae3-4336-8479-3ba18dbc45ca 00000020:00000080:3.0:1787365229.483507:0:7624:0:(genops.c:885:class_export_put()) final put ffff9f27abe8b800/8662a6a5-8ae3-4336-8479-3ba18dbc45ca 00000020:00000080:1.0:1787365229.483996:0:36:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27abe8b800/8662a6a5-8ae3-4336-8479-3ba18dbc45ca for lustre-OST0001 00000020:00000080:1.0:1787365229.484071:0:36:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f27abe8e000 for lustre-OST0001 00010000:00010000:1.0:1787365229.940387:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365230.964023:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787365231.355113:0:11664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787365231.988994:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365233.011171:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365233.017991:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365233.018159:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365233.018217:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365233.018313:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003468800 00000100:00100000:0.0:1787365233.018326:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003468800 00000100:00100000:0.0:1787365233.018404:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003468672 00000100:00100000:0.0:1787365233.018408:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003468672 00000100:00100000:0.0:1787365233.018449:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 135 00000100:00100000:0.0:1787365233.018460:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2361:x1874188003468800:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365233.018558:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b36d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2361:x1874188003468800:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 99us (398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365233.018566:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 135 00000100:00100000:0.0:1787365233.018586:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 136 00000100:00100000:0.0:1787365233.018593:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2361:x1874188003468672:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365233.018621:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b34380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2361:x1874188003468672:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 29us (404us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365233.018656:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 136 00000100:00080000:3.0:1787365233.019431:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365233.019607:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003468544 00000100:00100000:2.0:1787365233.019616:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003468544 00000100:00100000:3.0:1787365233.019796:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 286 00000100:00100000:3.0:1787365233.019806:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2361:x1874188003468544:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365233.019871:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b5050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2361:x1874188003468544:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 67us (1894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365233.019878:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 286 00000100:00100000:3.0:1787365233.526356:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2686971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024477824:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787365233.526464:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365233.526569:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024477824 00000100:00100000:3.0:1787365233.526578:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024477824 00000100:00100000:3.0:1787365233.526679:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:3.0:1787365233.526692:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2686970380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024477824:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787365233.526737:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365233.526792:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2686970380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024477824:12345-0@lo:13:osp-pre-0-0.0 Request processed in 104us (328us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365233.526800:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00080000:3.0:1787365233.526843:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:3.0:1787365233.526879:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f2686971c00 x1874188024477824/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365249 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365233.526903:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2686971c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024477824:0@lo:13:osp-pre-0-0.0 00000001:02000400:1.0:1787365233.826511:0:11834:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1a: Test manual lfs pcc attach with manual HSM restore ========================================================== 22:20:31 (1787365231) 00010000:00010000:2.0:1787365234.043095:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365234.547610:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024478080:0@lo:400:kworker.0 00000100:00100000:0.0:1787365234.547754:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365234.547875:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024478080 00000100:00100000:1.0:1787365234.547885:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024478080 00000100:00100000:2.0:1787365234.547937:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024477952:0@lo:400:kworker.0 00000100:00100000:1.0:1787365234.547954:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 137 00000100:00100000:1.0:1787365234.547966:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024478080:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365234.547986:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365234.548021:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874188024478464:0@lo:400:kworker.0 00000100:00100000:1.0:1787365234.548035:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb733100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024478080:12345-0@lo:400:kworker.0 Request processed in 70us (280us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365234.548044:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 137 00000100:00100000:2.0:1787365234.548054:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365234.548156:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaaca80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024478080:0@lo:400:kworker.0 00000100:00100000:0.0:1787365234.548164:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024478592:0@lo:400:kworker.0 00000100:00100000:1.0:1787365234.551137:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024478464 00000100:00100000:1.0:1787365234.551159:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024478464 00000100:00100000:1.0:1787365234.553163:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 138 00000100:00100000:1.0:1787365234.553212:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874188024478464:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365234.553514:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024478208:0@lo:400:kworker.0 00000100:00100000:3.0:1787365234.561373:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365234.561430:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279808e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024478720:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787365234.561475:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365234.561522:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787365234.561529:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024478336:0@lo:400:kworker.0 00000100:00100000:3.0:1787365234.561585:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:3.0:1787365234.561698:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365234.561720:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024478720 00000100:00100000:3.0:1787365234.561729:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024478720 00000100:00100000:3.0:1787365234.561796:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787365234.561807:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024478720:12345-0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365234.562449:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024477952 00000100:00100000:1.0:1787365234.562457:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024477952 00000100:00100000:1.0:1787365234.562664:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 287 00000100:00100000:1.0:1787365234.562674:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024477952:12345-0@lo:400:kworker.0 00002000:00000024:3.0:1787365234.562722:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365234.562791:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024478720:12345-0@lo:13:osp-pre-1-0.0 Request processed in 984us (1313us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365234.562802:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:1.0:1787365234.562821:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b6450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024477952:12345-0@lo:400:kworker.0 Request processed in 147us (14834us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365234.562885:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 287 00000100:00080000:3.0:1787365234.562896:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787365234.562950:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279808e300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024478720:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365234.562994:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024478208 00000100:00100000:1.0:1787365234.563002:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024478208 00000100:00100000:3.0:1787365234.563015:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024478336 00000100:00100000:3.0:1787365234.563021:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024478336 00000100:00100000:1.0:1787365234.563047:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 139 00000100:00100000:1.0:1787365234.563058:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2686971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024478208:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365234.563111:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2686971c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024478208:12345-0@lo:400:kworker.0 Request processed in 56us (1749us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365234.563119:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 139 00000100:00080000:1.0:1787365234.563185:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365234.563229:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaadf80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024477952:0@lo:400:kworker.0 00000100:00100000:2.0:1787365234.563311:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6c45f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024478208:0@lo:400:kworker.0 00000100:00100000:3.0:1787365234.563727:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787365234.563743:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024478336:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365234.563819:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae87b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024478336:12345-0@lo:400:kworker.0 Request processed in 81us (2232us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365234.563893:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:1.0:1787365234.564054:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbfad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874188024478464:12345-0@lo:400:kworker.0 Request processed in 10866us (15999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365234.564063:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 138 00010000:00080000:2.0:1787365234.564481:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bbdc5180 x1874188024478336/t0(0) o400->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 224/224 e 0 to 0 dl 1787365250 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365234.564495:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024478336:0@lo:400:kworker.0 00000100:00100000:2.0:1787365234.564531:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874188024478464:0@lo:400:kworker.0 00000100:00100000:0.0:1787365234.568474:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365234.568714:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024478592 00000100:00100000:2.0:1787365234.568726:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024478592 00000100:00100000:2.0:1787365234.568814:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787365234.568825:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024478592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365234.568928:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024478592:12345-0@lo:400:kworker.0 Request processed in 105us (466us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365234.568937:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787365234.569035:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb733480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024478592:0@lo:400:kworker.0 00010000:00010000:1.0:1787365235.060070:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365236.061782:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365236.061857:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003468928 00000100:00100000:1.0:1787365236.061871:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003468928 00000100:00100000:1.0:1787365236.061969:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:1.0:1787365236.061981:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:10231:x1874188003468928:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787365236.062007:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365236.062037:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46efc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989004 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365236.062157:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46f03 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365236.062173:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46f03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365236.062189:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46f03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787365236.062474:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787365236.062480:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000100:00080000:3.0:1787365236.062667:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000004:00010000:1.0:1787365236.062984:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46f03 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365236.063021:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46efc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989004 expref: 7 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365236.063043:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46f03 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989004 expref: 6 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365236.063053:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2784761200) 00010000:00010000:1.0:1787365236.063056:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787365236.063060:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798114200, rc 0) 00000100:00100000:1.0:1787365236.063489:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae85500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:10231:x1874188003468928:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1158us (1369us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365236.063500:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:0.0:1787365236.070369:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365236.070463:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003469056 00000100:00100000:2.0:1787365236.070477:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003469056 00000100:00100000:2.0:1787365236.070547:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:2.0:1787365236.070559:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:10232:x1874188003469056:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365236.070586:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365236.070613:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46f0a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898900b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.070724:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46f11 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.070742:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46f11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.070756:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46f11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.070773:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb46f18 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.070780:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb46f18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.070786:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb46f18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.071555:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb46f1f lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.071569:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb46f1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.071579:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb46f1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365236.071717:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787365236.071722:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365236.071811:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb46f1f lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.071826:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46f11 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.071833:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46f11 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.071840:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46f11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.071848:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cc600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365236.071852:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46f11 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.071861:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46f11 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.071878:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2784761200) 00010000:00010000:2.0:1787365236.071889:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365236.071896:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46f11 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.071912:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46f11 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.071929:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb46f18 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.071935:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb46f18 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.071941:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb46f18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.071946:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cc800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365236.071949:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb46f18 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.071955:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb46f18 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.071963:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9f27988df800) 00010000:00010000:2.0:1787365236.071965:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365236.071968:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb46f18 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.071973:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb46f18 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.072008:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46f0a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898900b expref: 8 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.072034:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb46f1f lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898900b expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.072042:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f27988df600) 00010000:00010000:2.0:1787365236.072044:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787365236.072046:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cce00, rc 0) 00000100:00100000:2.0:1787365236.072375:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb733480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:10232:x1874188003469056:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1816us (2018us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365236.072386:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00010000:00010000:2.0:1787365236.082917:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365236.089771:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365236.090336:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003469312 00000100:00100000:2.0:1787365236.090352:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003469312 00000100:00100000:2.0:1787365236.090491:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:2.0:1787365236.090504:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:10232:x1874188003469312:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365236.090802:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365236.090842:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46f26 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989012 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.090942:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb46f2d lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.090961:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb46f2d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.090975:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb46f2d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.091017:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46f34 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.091025:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46f34 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.091032:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46f34 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.091817:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46f3b lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.091840:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46f3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.091850:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46f3b lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365236.091864:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787365236.092111:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb46f2d lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.092120:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb46f2d lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.092128:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb46f2d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.092138:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cc800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365236.092144:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb46f2d lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.092163:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb46f2d lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.092178:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f27988df600) 00010000:00010000:2.0:1787365236.092181:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365236.092187:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb46f2d lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.092194:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb46f2d lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.092209:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46f34 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.092214:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46f34 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.092221:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46f34 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.092225:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cc600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365236.092228:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46f34 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.092234:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46f34 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.092242:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9f27988df800) 00010000:00010000:2.0:1787365236.092244:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365236.092258:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46f34 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.092278:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb46f34 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.094097:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb46f26 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989012 expref: 10 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.094128:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46f3b lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989012 expref: 9 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365236.094259:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f27988dfd00) 00010000:00010000:2.0:1787365236.094263:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365236.094269:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cd800, rc 0) 00000100:00100000:2.0:1787365236.094375:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb730380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:10232:x1874188003469312:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 3872us (4619us total) trans 4294967309 rc 0/0 00000100:00100000:2.0:1787365236.094386:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:3.0:1787365236.100421:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365236.101128:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003469440 00000100:00100000:1.0:1787365236.101141:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003469440 00000100:00100000:1.0:1787365236.101315:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:1.0:1787365236.101326:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:10232:x1874188003469440:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787365236.101471:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae86d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:10232:x1874188003469440:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 147us (1315us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365236.101480:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000040:00080000:2.0:1787365236.467714:0:11664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787365237.111481:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365238.133043:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365238.133097:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365238.133113:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003469568 00000100:00100000:0.0:1787365238.133124:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365238.133128:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003469568 00000100:00100000:3.0:1787365238.133196:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 288 00000100:00100000:3.0:1787365238.133209:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2359:x1874188003469568:12345-192.168.203.13@tcp:400:kworker.0 00010000:00010000:0.0:1787365238.133217:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365238.133322:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b4450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2359:x1874188003469568:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 116us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365238.133331:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 288 00000100:00100000:1.0:1787365238.134251:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003469696 00000100:00100000:1.0:1787365238.134264:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003469696 00000100:00100000:1.0:1787365238.134343:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003469824 00000100:00100000:1.0:1787365238.134347:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003469824 00000100:00100000:1.0:1787365238.134377:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00100000:1.0:1787365238.134387:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:2360:x1874188003469696:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365238.134460:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb731180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:2360:x1874188003469696:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 73us (1362us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365238.134467:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00100000:1.0:1787365238.134484:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00100000:1.0:1787365238.134491:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2359:x1874188003469824:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365238.134517:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb730e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2359:x1874188003469824:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (1393us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365238.134522:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00080000:3.0:1787365238.135415:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365238.629925:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365238.629960:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003469952 00000100:00100000:0.0:1787365238.629972:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003469952 00000100:00100000:0.0:1787365238.630051:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:0.0:1787365238.630064:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:10276:x1874188003469952:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1787365238.630091:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365238.630118:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb46f49 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989019 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.630201:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46f50 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.630219:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46f50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.630244:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46f50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.630274:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46f57 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.630282:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46f57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.630289:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46f57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.631104:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46f50 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.631119:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46f50 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.631127:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46f50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.631134:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365238.631139:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46f50 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.631148:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46f50 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.631165:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2784761200) 00010000:00010000:0.0:1787365238.631170:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365238.631177:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46f50 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.631184:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46f50 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.631205:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46f57 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.631212:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46f57 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.631219:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46f57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.631224:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780031c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365238.631227:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46f57 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.631247:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46f57 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.631256:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9f278a0ad000) 00010000:00010000:0.0:1787365238.631259:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365238.631263:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46f57 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.631269:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46f57 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.631319:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb46f49 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989019 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.631332:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2784761200) 00010000:00010000:0.0:1787365238.631335:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365238.631344:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb46f49 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989019 expref: 10 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.631356:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780031a00, rc 0) 00000100:00100000:0.0:1787365238.631749:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae85c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:10276:x1874188003469952:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1685us (1836us total) trans 0 rc 301/301 00000100:00100000:0.0:1787365238.631761:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:0.0:1787365238.640590:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365238.640669:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003470208 00000100:00100000:0.0:1787365238.640681:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003470208 00000100:00100000:0.0:1787365238.640828:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:0.0:1787365238.640841:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:10276:x1874188003470208:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:0.0:1787365238.640918:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365238.640952:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb46f03 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989004 expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.640974:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2784761200) 00010000:00010000:0.0:1787365238.640988:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787365238.641314:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030600/0x872d29295eb46f5e lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.641331:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030600/0x872d29295eb46f5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.641343:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030600/0x872d29295eb46f5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.641355:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb46f65 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.641448:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb46f65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.641456:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb46f65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365238.642889:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787365238.642911:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030600/0x872d29295eb46f5e lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.642923:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030600/0x872d29295eb46f5e lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.642931:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030600/0x872d29295eb46f5e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.642938:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365238.642943:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030600/0x872d29295eb46f5e lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.642951:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030600/0x872d29295eb46f5e lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.642968:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f278a0adf00) 00010000:00010000:0.0:1787365238.642971:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365238.642976:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030600/0x872d29295eb46f5e lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.642983:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030600/0x872d29295eb46f5e lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787365238.643017:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000010b5a94 reply state 0000000097a7b6b0 transno 4294967310 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb46f65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365238.643027:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787365238.643177:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+10:10276:x1874188003470208:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 2334us (2595us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787365238.643188:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:3.0:1787365238.643541:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bae84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024478848:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787365238.643603:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365238.643692:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024478848 00000100:00100000:3.0:1787365238.643699:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024478848 00000100:00100000:3.0:1787365238.643764:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787365238.643774:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024478848:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787365238.643812:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00080000:0.0:1787365238.643825:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787365238.643858:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae87100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024478848:12345-0@lo:13:osp-pre-0-0.0 Request processed in 86us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365238.643865:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00010000:00080000:0.0:1787365238.644053:0:3313:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27bae84380 x1874188024478848/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365254 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365238.644075:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bae84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024478848:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787365238.654852:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb46f65 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.661887:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb46f65 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.661897:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb46f65 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.661918:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365238.661925:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb46f65 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.661937:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb46f65 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.661960:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9f278a0ad900) 00010000:00010000:1.0:1787365238.661964:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365238.661969:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb46f65 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.661977:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb46f65 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365238.736411:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365238.736576:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003470336 00000100:00100000:3.0:1787365238.736605:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003470336 00000100:00100000:3.0:1787365238.736720:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:3.0:1787365238.736732:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:10284:x1874188003470336:12345-192.168.203.13@tcp:101:lctl.0 00010000:00010000:3.0:1787365238.736763:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365238.736795:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb46f6c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989020 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365238.736887:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45400/0x872d29295eb46f73 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365238.736904:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45400/0x872d29295eb46f73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365238.736917:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45400/0x872d29295eb46f73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365238.737008:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787365238.737013:0:6704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:3.0:1787365238.737065:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45400/0x872d29295eb46f73 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365238.737093:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb46f6c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989020 expref: 11 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365238.737114:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45400/0x872d29295eb46f73 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989020 expref: 10 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365238.737123:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2789e48c00) 00010000:00010000:3.0:1787365238.737126:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787365238.737131:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45400, rc 0) 00000100:00100000:3.0:1787365238.737222:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787321c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+10:10284:x1874188003470336:12345-192.168.203.13@tcp:101:lctl.0 Request processed in 492us (825us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365238.737240:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:1.0:1787365238.820349:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365238.820502:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003470464 00000100:00100000:0.0:1787365238.820514:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003470464 00000100:00100000:0.0:1787365238.820594:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:0.0:1787365238.820607:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+10:10290:x1874188003470464:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1787365238.820665:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365238.820693:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb46f7a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989027 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.820777:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46f81 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.820794:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46f81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.820808:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46f81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.820841:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46f88 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.820849:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46f88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.820855:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46f88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.821001:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030600/0x872d29295eb46f8f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.821010:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030600/0x872d29295eb46f8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.821017:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030600/0x872d29295eb46f8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365238.821052:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:0.0:1787365238.821057:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787365238.821106:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030600/0x872d29295eb46f8f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.821121:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46f81 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.821127:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46f81 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.821134:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46f81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.821151:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780031c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365238.821156:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46f81 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.821164:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46f81 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.821179:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2789e48c00) 00010000:00010000:0.0:1787365238.821182:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365238.821187:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46f81 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.821194:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46f81 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.821209:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46f88 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.821215:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46f88 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.821221:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46f88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.821226:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365238.821240:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46f88 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.821247:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46f88 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.821265:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x7aaf747d (ffff9f278a0adf00) 00010000:00010000:0.0:1787365238.821268:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365238.821271:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46f88 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.821278:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb46f88 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x7aaf747d bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.821378:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb46f7a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989027 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.821394:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030600/0x872d29295eb46f8f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989027 expref: 11 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.821402:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:0.0:1787365238.821405:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787365238.821408:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780030600, rc 0) 00000100:00100000:0.0:1787365238.821477:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+11:10290:x1874188003470464:12345-192.168.203.13@tcp:101:bash.0 Request processed in 873us (1143us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365238.821486:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:0.0:1787365238.828725:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365238.829214:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003470720 00000100:00100000:1.0:1787365238.829227:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003470720 00000100:00100000:1.0:1787365238.829335:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:1.0:1787365238.829348:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+11:10290:x1874188003470720:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1787365238.829377:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365238.829405:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46f96 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898902e expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.829588:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb46f9d lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.829606:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb46f9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.829678:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb46f9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.832123:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb46fa4 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.832147:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb46fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.832161:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb46fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:1.0:1787365238.835244:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x2:0x0], index 0: 0 00010000:00010000:1.0:1787365238.835479:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114600/0x872d29295eb46fab lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.835495:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114600/0x872d29295eb46fab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.835508:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114600/0x872d29295eb46fab lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.835545:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb46f9d lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.835553:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb46f9d lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.835561:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb46f9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.835567:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798115c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365238.835583:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb46f9d lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.835591:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb46f9d lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.835605:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:1.0:1787365238.835608:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365238.835613:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb46f9d lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.835620:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb46f9d lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787365238.835659:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000bf6b004b reply state 00000000a87e1dae transno 4294967311 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb46fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365238.835668:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:1.0:1787365238.835704:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb46f96 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898902e expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.838211:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114600/0x872d29295eb46fab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898902e expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.838222:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f2784761a00) 00010000:00010000:1.0:1787365238.838226:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787365238.838241:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798114600, rc 0) 00000100:00100000:1.0:1787365238.838333:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787320a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:10290:x1874188003470720:12345-192.168.203.13@tcp:101:bash.0 Request processed in 8987us (9622us total) trans 4294967311 rc 0/0 00000100:00100000:1.0:1787365238.838343:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:2.0:1787365238.852463:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365238.852564:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003470848 00000100:00100000:1.0:1787365238.852575:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003470848 00000100:00100000:1.0:1787365238.852620:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:1.0:1787365238.852643:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:0+-99:2358:x1874188003470848:12345-192.168.203.13@tcp:8:bash.0 00010000:00080000:1.0:1787365238.852675:0:10260:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp t0 exp 0000000000000000 cur 356 last 0 00000020:00000080:1.0:1787365238.852720:0:10260:0:(genops.c:1385:class_connect()) connect: client 8662a6a5-8ae3-4336-8479-3ba18dbc45ca, cookie 0x872d29295eb46fb9 00002000:00100000:1.0:1787365238.852740:0:10260:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 8662a6a5-8ae3-4336-8479-3ba18dbc45ca/ffff9f26847f1800 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392e ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:1.0:1787365238.852750:0:10260:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00010000:00010000:0.0:1787365238.853364:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb46fa4 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.853378:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb46fa4 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.853386:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb46fa4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.853406:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365238.853411:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb46fa4 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.853419:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb46fa4 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.853439:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f2784761900) 00010000:00010000:0.0:1787365238.853442:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365238.853447:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb46fa4 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.853453:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb46fa4 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00002000:00080000:1.0:1787365238.853510:0:10260:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:1.0:1787365238.853545:0:10260:0:(import.c:65:import_set_state_nolock()) ffff9f26847f0000 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787365238.854577:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2358:x1874188003470848:12345-192.168.203.13@tcp:8:bash.0 Request processed in 1928us (2117us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365238.854590:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:2.0:1787365238.858406:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365238.858552:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003470976 00000100:00100000:1.0:1787365238.858561:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003470976 00000100:00100000:1.0:1787365238.858673:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:1.0:1787365238.858687:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:0:x1874188003470976:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1787365238.858706:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365238.858730:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d42d3039/0x872d29295eb46fc0 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989035 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787365238.858759:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787365238.858778:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=356s v=(0 0) 00010000:00010000:1.0:1787365238.858782:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365238.858791:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d42d3039/0x872d29295eb46fc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989035 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.858832:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000d42d3039/0x872d29295eb46fc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989035 expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365238.858845:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115600, rc 0) 00000100:00100000:1.0:1787365238.858994:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:0:x1874188003470976:12345-192.168.203.13@tcp:101:bash.0 Request processed in 310us (596us total) trans 0 rc 0/0 00000100:00080000:0.0:1787365238.859216:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787365238.861610:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365238.861737:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003471104 00000100:00100000:2.0:1787365238.861747:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003471104 00000100:00100000:2.0:1787365238.861802:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:2.0:1787365238.861811:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:10290:x1874188003471104:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1787365238.861829:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365238.861848:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001a1cd234/0x872d29295eb46fc7 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898903c expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365238.861886:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000d42d3039/0x872d29295eb46fc0 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989035 expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365238.861907:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365238.861912:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365238.861918:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a1cd234/0x872d29295eb46fc7 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898903c expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365238.861959:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000d42d3039/0x872d29295eb46fc0 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989035 expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365238.861974:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000d42d3039/0x872d29295eb46fc0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989035 expref: 9 pid: 6681 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365238.861988:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbf9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1874188024478976:192.168.203.13@tcp:104: 00000100:00100000:2.0:1787365238.862076:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bbb94cc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365238.862387:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:3.0:1787365238.867983:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365238.868292:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003471232 00000100:00100000:0.0:1787365238.868301:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003471232 00010000:00010000:0.0:1787365238.868344:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000d42d3039/0x872d29295eb46fc0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989035 expref: 9 pid: 6681 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365238.868389:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:0.0:1787365238.868398:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:2362:x1874188003471232:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787365238.868414:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365238.868442:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000d42d3039/0x872d29295eb46fc0 lrc: 5/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989035 expref: 9 pid: 6681 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.868477:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000d42d3039/0x872d29295eb46fc0 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989035 expref: 9 pid: 6681 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.868504:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365238.868508:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365238.868517:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000001a1cd234/0x872d29295eb46fc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898903c expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.868528:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001a1cd234/0x872d29295eb46fc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898903c expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365238.868562:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000001a1cd234/0x872d29295eb46fc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898903c expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365238.868576:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787322300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5820:1874188024479104:192.168.203.13@tcp:105: 00000100:00100000:0.0:1787365238.868684:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2684531cc0 going to sleep for 11 seconds 00010000:00010000:2.0:1787365238.868929:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d42d3039/0x872d29295eb46fc0 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989035 expref: 9 pid: 6681 timeout: 456 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365238.868955:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbf9c00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1874188024478976:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365238.868979:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001a1cd234/0x872d29295eb46fc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898903c expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365238.868989:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cc800, rc 0) 00000100:00100000:2.0:1787365238.869023:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787320000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:10290:x1874188003471104:12345-192.168.203.13@tcp:101:bash.0 Request processed in 7212us (7420us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365238.869041:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:3.0:1787365238.876305:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787322300 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5820:1874188024479104:192.168.203.13@tcp:105: 00010000:00010000:3.0:1787365238.876349:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365238.876425:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2362:x1874188003471232:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 8025us (8449us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365238.876438:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:1.0:1787365238.879940:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365238.881024:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003471488 00000100:00100000:0.0:1787365238.881044:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003471488 00000100:00100000:0.0:1787365238.881148:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:0.0:1787365238.881161:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:10290:x1874188003471488:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:0.0:1787365238.883779:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:10290:x1874188003471488:12345-192.168.203.13@tcp:35:bash.0 Request processed in 2604us (3831us total) trans 4294967312 rc 0/0 00000100:00100000:0.0:1787365238.883797:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:2.0:1787365239.008193:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365239.008319:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003471744 00000100:00100000:0.0:1787365239.008343:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003471744 00000100:00100000:0.0:1787365239.008407:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:0.0:1787365239.008418:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:10300:x1874188003471744:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1787365239.008443:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365239.008463:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46fce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989043 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365239.008575:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:0.0:1787365239.008723:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46fce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989043 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.008739:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2789e48c00) 00010000:00010000:0.0:1787365239.008742:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787365239.008747:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46fce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989043 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.008777:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780031c00, rc 0) 00000100:00100000:0.0:1787365239.008831:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+15:10300:x1874188003471744:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 415us (648us total) trans 4294967313 rc 301/301 00000100:00100000:0.0:1787365239.008838:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:2.0:1787365239.011699:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365239.012058:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003472000 00000100:00100000:1.0:1787365239.012067:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003472000 00000100:00100000:1.0:1787365239.012121:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1787365239.012132:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+15:10300:x1874188003472000:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1787365239.012401:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+16:10300:x1874188003472000:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 271us (708us total) trans 4294967314 rc 0/0 00000100:00100000:1.0:1787365239.012409:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1787365239.119146:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365239.121953:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003472128 00000100:00100000:3.0:1787365239.121968:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003472128 00000100:00100000:3.0:1787365239.122049:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:3.0:1787365239.122061:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+16:10306:x1874188003472128:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1787365239.122086:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365239.122105:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb46fdc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898904a expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.122167:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb46fe3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.122182:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb46fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.122192:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb46fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365239.122256:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00000004:00200000:3.0:1787365239.122261:0:6704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787365239.122286:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb46fe3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.122326:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb46fdc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898904a expref: 18 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.122344:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb46fe3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898904a expref: 17 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.122353:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:3.0:1787365239.122355:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787365239.122359:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45800, rc 0) 00000100:00100000:3.0:1787365239.123744:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+17:10306:x1874188003472128:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1676us (4597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365239.123766:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:3.0:1787365239.127255:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365239.127346:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003472384 00000100:00100000:0.0:1787365239.127355:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003472384 00000100:00100000:0.0:1787365239.127417:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:0.0:1787365239.127429:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+17:10306:x1874188003472384:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1787365239.127459:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365239.127480:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb46fea lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989051 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.127593:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46ff1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.127607:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.127616:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46ff1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365239.127657:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787365239.127787:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb46fea lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989051 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.127804:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46ff1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989051 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.127812:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f2784761a00) 00010000:00010000:0.0:1787365239.127815:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787365239.127819:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780031c00, rc 0) 00000100:00100000:0.0:1787365239.127874:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae85880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+19:10306:x1874188003472384:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 447us (628us total) trans 4294967315 rc 0/0 00000100:00100000:0.0:1787365239.127889:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:0.0:1787365239.134664:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365239.134912:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003472640 00000100:00100000:1.0:1787365239.134922:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003472640 00000100:00100000:1.0:1787365239.134976:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:1.0:1787365239.134986:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+19:10306:x1874188003472640:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1787365239.135010:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365239.135030:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115a00/0x872d29295eb46fff lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989058 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365239.135158:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb47006 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365239.135174:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb47006 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365239.135187:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb47006 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787365239.135199:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787365239.135359:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115a00/0x872d29295eb46fff lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989058 expref: 22 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365239.135379:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb47006 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989058 expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365239.135388:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f2784761a00) 00010000:00010000:1.0:1787365239.135391:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:1.0:1787365239.135394:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115800, rc 0) 00000100:00100000:1.0:1787365239.135464:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787321880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:10306:x1874188003472640:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 479us (808us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787365239.135472:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:3.0:1787365239.144416:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365239.144571:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003472768 00000100:00100000:2.0:1787365239.144580:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003472768 00000100:00100000:2.0:1787365239.144683:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:2.0:1787365239.144694:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:2362:x1874188003472768:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787365239.144710:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365239.144736:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb46ff1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989051 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365239.144753:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f2784761a00) 00010000:00010000:2.0:1787365239.144758:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365239.144802:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae85180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+20:2362:x1874188003472768:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 110us (394us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365239.144809:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:2.0:1787365239.147163:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365239.147311:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003472896 00000100:00100000:0.0:1787365239.147320:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003472896 00000100:00100000:0.0:1787365239.147388:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:0.0:1787365239.147397:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2361:x1874188003472896:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:0.0:1787365239.147455:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093cf356f/0x872d29295eb47014 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.147474:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001a1cd234/0x872d29295eb46fc7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898903c expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.147483:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365239.147486:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787365239.147491:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093cf356f/0x872d29295eb47014 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.147524:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001a1cd234/0x872d29295eb46fc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898903c expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.147539:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001a1cd234/0x872d29295eb46fc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898903c expref: 7 pid: 6682 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365239.147555:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787321180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1874188024479232:192.168.203.13@tcp:104: 00000100:00100000:0.0:1787365239.147882:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2684531180 going to sleep for 11 seconds 00010000:00010000:0.0:1787365239.162414:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365239.162518:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787321180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1874188024479232:192.168.203.13@tcp:104: 00010000:00010000:0.0:1787365239.162552:0:6680:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 0000000093cf356f/0x872d29295eb47014 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365239.162687:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365239.162737:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003473024 00000100:00100000:0.0:1787365239.162752:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003473024 00002000:00100000:0.0:1787365239.162795:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9f2787321180 x1874188003473024/t0(0) o4->8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp:145/0 lens 504/0 e 0 to 0 dl 1787365250 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787365239.162804:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2787321180 with x1874188003473024 ext(0->12) 00010000:00010000:0.0:1787365239.162811:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001a1cd234/0x872d29295eb46fc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898903c expref: 8 pid: 6682 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.162835:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001a1cd234/0x872d29295eb46fc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898903c expref: 8 pid: 6682 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787365239.162844:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9f2787321180 00000100:00100000:0.0:1787365239.162871:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1787365239.162881:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2359:x1874188003473024:12345-192.168.203.13@tcp:4:lfs.0 00000001:00100000:1.0:1787365239.236193:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8662a6a5-8ae3-4336-8479-3ba18dbc45ca 00000100:00100000:0.0:1787365239.322693:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787321180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:2359:x1874188003473024:12345-192.168.203.13@tcp:4:lfs.0 Request processed in 159802us (159996us total) trans 4294967299 rc 0/0 00000100:00100000:0.0:1787365239.322708:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00002000:00100000:0.0:1787365239.322722:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x2:0x0] (0->12) req@ffff9f2787321180 x1874188003473024/t4294967299(0) o4->8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp:145/0 lens 504/448 e 0 to 0 dl 1787365250 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787365239.322734:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2787321180 with x1874188003473024 ext(0->12) 00010000:00010000:0.0:1787365239.322745:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000001a1cd234/0x872d29295eb46fc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898903c expref: 9 pid: 6682 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.322765:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000001a1cd234/0x872d29295eb46fc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898903c expref: 9 pid: 6682 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787365239.322789:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9f2787321180 00000100:00100000:1.0:1787365239.331072:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365239.332081:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003473152 00000100:00100000:0.0:1787365239.332092:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003473152 00010000:00010000:0.0:1787365239.332136:0:8434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001a1cd234/0x872d29295eb46fc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898903c expref: 9 pid: 6682 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365239.332182:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:0.0:1787365239.332191:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:2361:x1874188003473152:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787365239.332207:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787365239.332235:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787365239.332238:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb mtime from disk: 0 -> 1787365238 00002000:00010000:0.0:1787365239.332241:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb atime from disk: 0 -> 1787365238 00002000:00010000:0.0:1787365239.332243:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x2:0x0] updating lvb ctime from disk: 0 -> 1787365238 00010000:00010000:0.0:1787365239.332250:0:8434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001a1cd234/0x872d29295eb46fc7 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898903c expref: 9 pid: 6682 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.332264:0:8434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001a1cd234/0x872d29295eb46fc7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898903c expref: 9 pid: 6682 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.332288:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001a1cd234/0x872d29295eb46fc7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898903c expref: 9 pid: 6682 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.332304:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787365239.332308:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787365239.332314:0:8434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000093cf356f/0x872d29295eb47014 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.332338:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000093cf356f/0x872d29295eb47014 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.332378:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365239.332450:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808dc00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2361:x1874188003473152:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 259us (1386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365239.332457:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00010000:00010000:2.0:1787365239.333370:0:6680:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 0000000093cf356f/0x872d29295eb47014 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365239.333382:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000093cf356f/0x872d29295eb47014 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365239.333421:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000093cf356f/0x872d29295eb47014 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365239.333456:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000093cf356f/0x872d29295eb47014 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365239.333465:0:6680:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000093cf356f/0x872d29295eb47014 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365239.333472:0:6680:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030800 already unused, calling callback (ffffffffc1672420) 00010000:00010000:2.0:1787365239.333476:0:6680:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000093cf356f/0x872d29295eb47014 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365239.333485:0:6680:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000093cf356f/0x872d29295eb47014 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365239.333502:0:6680:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000093cf356f/0x872d29295eb47014 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365239.333510:0:6680:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000093cf356f/0x872d29295eb47014 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365239.333592:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2361:x1874188003472896:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 186195us (186436us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365239.333602:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:1.0:1787365239.339776:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365239.339907:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003473408 00000100:00100000:2.0:1787365239.339916:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003473408 00000100:00100000:2.0:1787365239.339968:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:2.0:1787365239.339993:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+20:10306:x1874188003473408:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:2.0:1787365239.340060:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x4:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb47006 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989058 expref: 20 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787365239.340356:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967317 00000001:00080000:2.0:1787365239.340435:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967318 00000001:00080000:2.0:1787365239.341128:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967319 00010000:00010000:2.0:1787365239.341195:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb4701b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365239.341212:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114600/0x872d29295eb46fab lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898902e expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365239.341221:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb4701b lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365239.341272:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114600/0x872d29295eb46fab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898902e expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365239.341290:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114600/0x872d29295eb46fab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898902e expref: 24 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365239.341305:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbfb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1874188024479360:192.168.203.13@tcp:104: 00000100:00100000:2.0:1787365239.341397:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bbb94480 going to sleep for 11 seconds 00000100:00100000:2.0:1787365239.350122:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbfb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1874188024479360:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365239.350154:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb4701b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365239.353165:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365239.353309:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003473536 00000100:00100000:3.0:1787365239.353325:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003473536 00010000:00010000:3.0:1787365239.353393:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114600/0x872d29295eb46fab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898902e expref: 25 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365239.353443:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:3.0:1787365239.353454:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+25:2362:x1874188003473536:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365239.353473:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365239.353481:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114600/0x872d29295eb46fab lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898902e expref: 25 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.353498:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114600/0x872d29295eb46fab lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898902e expref: 25 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.353549:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114600/0x872d29295eb46fab lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898902e expref: 25 pid: 5835 timeout: 456 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.353579:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f2784761a00) 00010000:00010000:3.0:1787365239.353585:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb4701b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.353596:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb4701b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.353604:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb4701b lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.353686:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787365239.353771:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb4701b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365239.353799:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb4701b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365239.354905:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808f100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+24:2362:x1874188003473536:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 1442us (2272us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365239.354929:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00000001:00080000:1.0:1787365239.356301:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967320 00000001:00080000:1.0:1787365239.356790:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967321 00000100:00100000:1.0:1787365239.358352:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279808f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874188024479488:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:1.0:1787365239.358419:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365239.358454:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5d540 going to sleep for 11 seconds 00000100:00100000:3.0:1787365239.358771:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024479488 00000100:00100000:3.0:1787365239.358778:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024479488 00000100:00100000:3.0:1787365239.358819:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:3.0:1787365239.358828:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1874188024479488:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787365239.358920:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1874188024479488:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 93us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365239.358927:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787365239.359014:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279808f480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874188024479488:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787365239.359719:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967322 00000100:00100000:2.0:1787365239.359792:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbfb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874188024479616:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:2.0:1787365239.359830:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365239.359859:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2797aecb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787365239.360325:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024479616 00000100:00100000:3.0:1787365239.360331:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024479616 00000100:00100000:3.0:1787365239.360361:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787365239.360368:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5837:x1874188024479616:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:3.0:1787365239.360546:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5837:x1874188024479616:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 178us (715us total) trans 4294967300 rc 0/0 00000100:00100000:3.0:1787365239.360553:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787365239.361118:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbfb100 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874188024479616:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:2.0:1787365239.361178:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967323 00010000:00010000:2.0:1787365239.361699:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb4701b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365239.361710:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb4701b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365239.361717:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb4701b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365239.361723:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12ccc00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365239.361727:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb4701b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365239.361735:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb4701b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365239.361752:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f2784761a00) 00010000:00010000:2.0:1787365239.361755:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787365239.361759:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb4701b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365239.361765:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb4701b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787365239.362821:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x5:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787365239.363074:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].2, 64 off8320 00000004:00080000:2.0:1787365239.363086:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 356527460235ns, next at 357527457160ns, rc = 0 00000001:00080000:2.0:1787365239.363095:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967324 00010000:00010000:2.0:1787365239.363145:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f2784761a00) 00010000:00010000:2.0:1787365239.363149:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787365239.363158:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb47006 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989058 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365239.364452:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+27:10306:x1874188003473408:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 24456us (24683us total) trans 4294967325 rc 0/0 00000100:00100000:2.0:1787365239.364465:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000020:00080000:2.0:1787365239.364471:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:1.0:1787365239.369959:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365239.370179:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003473664 00000100:00100000:0.0:1787365239.370192:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003473664 00000100:00100000:0.0:1787365239.370279:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:0.0:1787365239.370291:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+27:10306:x1874188003473664:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1787365239.370323:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365239.370353:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb47022 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898905f expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.370429:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb47022 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898905f expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.370447:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb47022 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898905f expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.370469:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:0.0:1787365239.370473:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787365239.370477:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780031a00, rc 0) 00000100:00100000:0.0:1787365239.370557:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+28:10306:x1874188003473664:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 268us (621us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365239.370590:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:3.0:1787365239.379337:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365239.380217:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003473920 00000100:00100000:0.0:1787365239.380239:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003473920 00000100:00100000:0.0:1787365239.380314:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:0.0:1787365239.380325:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278ac6d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+28:10306:x1874188003473920:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1787365239.380585:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278ac6d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+29:10306:x1874188003473920:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 261us (1262us total) trans 4294967326 rc 0/0 00000100:00100000:0.0:1787365239.380594:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:2.0:1787365239.523395:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365239.523487:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003474176 00000100:00100000:1.0:1787365239.523501:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003474176 00000100:00100000:1.0:1787365239.523670:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:1.0:1787365239.523682:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+29:10317:x1874188003474176:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1787365239.523707:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365239.523728:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb47029 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989066 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787365239.524193:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 512 00010000:00010000:1.0:1787365239.524312:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb47029 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989066 expref: 31 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365239.524326:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2789e48c00) 00010000:00010000:1.0:1787365239.524329:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787365239.524333:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb47029 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989066 expref: 31 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365239.524347:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115600, rc 0) 00000100:00100000:1.0:1787365239.525060:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+30:10317:x1874188003474176:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1377us (1679us total) trans 4294967327 rc 301/301 00000100:00100000:1.0:1787365239.525069:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:3.0:1787365239.529247:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365239.529483:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003474304 00000100:00100000:0.0:1787365239.529491:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003474304 00000100:00100000:0.0:1787365239.529549:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:0.0:1787365239.529559:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+30:10317:x1874188003474304:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:0.0:1787365239.529645:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47037 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.529661:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47037 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.529674:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47037 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.529688:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb4703e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.529696:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb4703e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.529703:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb4703e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.529826:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47045 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.529836:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.529844:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787365239.530066:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.530080:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47037 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.530097:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47037 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.530104:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47037 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.530110:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365239.530114:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47037 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.530122:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47037 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.530133:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:0.0:1787365239.530136:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365239.530140:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47037 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.530153:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47037 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.530166:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb4703e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.530172:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb4703e lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.530178:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb4703e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.530182:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780031c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365239.530185:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb4703e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.530191:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb4703e lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.530197:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f278a0adf00) 00010000:00010000:0.0:1787365239.530200:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365239.530203:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb4703e lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.530209:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb4703e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.530222:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47045 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.530239:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47045 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.530253:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.530257:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365239.530260:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47045 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.530266:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47045 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.530274:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:0.0:1787365239.530277:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365239.530280:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47045 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.530285:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47045 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365239.530358:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae84e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+30:10317:x1874188003474304:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 799us (1133us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365239.530367:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:2.0:1787365239.539287:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365239.539443:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003474560 00000100:00100000:0.0:1787365239.539453:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003474560 00000100:00100000:0.0:1787365239.539510:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:0.0:1787365239.539520:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+30:10317:x1874188003474560:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1787365239.540182:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+31:10317:x1874188003474560:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 292us (531us total) trans 4294967328 rc 0/0 00000100:00100000:0.0:1787365239.540193:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:2.0:1787365239.588895:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365239.588970:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003474816 00000100:00100000:3.0:1787365239.588980:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003474816 00000100:00100000:3.0:1787365239.589042:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:3.0:1787365239.589052:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+31:10320:x1874188003474816:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1787365239.589076:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365239.589096:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb4704c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898906d expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.589168:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47053 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.589183:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47053 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.589428:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47053 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.589456:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4705a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.589464:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4705a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.589472:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4705a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.589819:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb47061 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.589829:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb47061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.590323:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb47061 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365239.590336:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:3.0:1787365239.590751:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47053 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.590760:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47053 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.590767:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47053 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.590774:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365239.590778:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47053 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.590786:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47053 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.590799:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:3.0:1787365239.590802:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365239.590807:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47053 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.590829:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47053 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.590843:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4705a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.590849:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4705a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.590854:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4705a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.592090:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365239.592096:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4705a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.592104:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4705a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.592117:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f2789e48000) 00010000:00010000:3.0:1787365239.592120:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365239.592123:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4705a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.592129:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4705a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.592191:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb4704c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898906d expref: 34 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.592330:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb47061 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898906d expref: 33 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365239.592351:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:3.0:1787365239.592353:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787365239.592356:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45000, rc 0) 00000100:00100000:3.0:1787365239.592444:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+33:10320:x1874188003474816:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 3386us (3549us total) trans 4294967329 rc 0/0 00000100:00100000:3.0:1787365239.592452:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:3.0:1787365239.599532:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365239.599674:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003474944 00000100:00100000:1.0:1787365239.599683:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003474944 00000100:00100000:1.0:1787365239.599733:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:1.0:1787365239.599743:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+33:10320:x1874188003474944:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:1.0:1787365239.599809:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb4706f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365239.599826:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb4706f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365239.599837:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb4706f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365239.599861:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb4706f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365239.599868:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb4706f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365239.599875:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb4706f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365239.599881:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798115600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365239.599885:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb4706f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365239.599893:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb4706f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365239.599921:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:1.0:1787365239.599924:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787365239.599929:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb4706f lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365239.599935:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb4706f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365239.600207:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae84a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+33:10320:x1874188003474944:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 465us (684us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365239.600216:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:2.0:1787365239.610404:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365239.610559:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003475200 00000100:00100000:1.0:1787365239.610568:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003475200 00000100:00100000:1.0:1787365239.610637:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:1.0:1787365239.610647:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+33:10320:x1874188003475200:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1787365239.610867:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c45f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+34:10320:x1874188003475200:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 220us (471us total) trans 4294967330 rc 0/0 00000100:00100000:1.0:1787365239.610875:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1787365239.667347:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bae85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024480000:0@lo:400:kworker.0 00000100:00100000:3.0:1787365239.667406:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365239.667458:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787365239.667464:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bae86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024480128:0@lo:400:kworker.0 00000100:00100000:3.0:1787365239.667483:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365239.667511:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024480000 00000100:00100000:3.0:1787365239.667517:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024480000 00000100:00100000:3.0:1787365239.667556:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024480128 00000100:00100000:3.0:1787365239.667558:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024480128 00000100:00100000:3.0:1787365239.667577:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787365239.667584:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024480000:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365239.667641:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae87800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024480000:12345-0@lo:400:kworker.0 Request processed in 41us (218us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365239.667648:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 142 00000100:00100000:3.0:1787365239.667663:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787365239.667668:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024480128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365239.667690:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae86300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024480128:12345-0@lo:400:kworker.0 Request processed in 23us (207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365239.667711:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 143 00000100:00100000:3.0:1787365239.667740:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bae86a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024480128:0@lo:400:kworker.0 00000100:00100000:3.0:1787365239.667748:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bae85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024480000:0@lo:400:kworker.0 00000100:00100000:2.0:1787365239.668344:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bae84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024479744:0@lo:400:kworker.0 00000100:00100000:2.0:1787365239.668382:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365239.668413:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bae86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024480256:0@lo:400:kworker.0 00000100:00100000:2.0:1787365239.668440:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365239.668461:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:2.0:1787365239.668467:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bae84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024479872:0@lo:400:kworker.0 00000100:00100000:2.0:1787365239.668488:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365239.668502:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279808ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024480384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787365239.668532:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365239.668556:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024480256 00000100:00100000:2.0:1787365239.668561:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024480256 00000100:00100000:2.0:1787365239.668592:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787365239.668600:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024480256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365239.668651:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024480256:12345-0@lo:400:kworker.0 Request processed in 52us (209us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365239.668657:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787365239.668675:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024480384 00000100:00100000:2.0:1787365239.668678:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024480384 00000100:00100000:2.0:1787365239.668697:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:2.0:1787365239.668702:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024480384:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787365239.668725:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365239.668750:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024480384:12345-0@lo:13:osp-pre-1-0.0 Request processed in 48us (217us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365239.668770:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787365239.669220:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024479744 00000100:00100000:1.0:1787365239.669235:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024479744 00000100:00100000:1.0:1787365239.669268:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787365239.669275:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024479744:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365239.669309:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b5850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024479744:12345-0@lo:400:kworker.0 Request processed in 35us (927us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365239.669315:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 289 00000100:00100000:1.0:1787365239.669358:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024479872 00000100:00100000:1.0:1787365239.669369:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024479872 00000100:00100000:1.0:1787365239.669394:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 144 00000100:00100000:1.0:1787365239.669400:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024479872:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365239.669429:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaadf80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024479872:12345-0@lo:400:kworker.0 Request processed in 29us (940us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365239.669435:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 144 00000100:00100000:2.0:1787365239.669488:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279808ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024480384:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787365239.669503:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bae84700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024479744:0@lo:400:kworker.0 00000100:00100000:2.0:1787365239.669513:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bae86680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024480256:0@lo:400:kworker.0 00000100:00100000:2.0:1787365239.669536:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bae84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024479872:0@lo:400:kworker.0 00000100:00080000:0.0:1787365239.669656:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787365239.669661:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000001:00080000:1.0:1787365239.762196:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967328 is committed 00000001:00080000:1.0:1787365239.762237:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967330 is committed 00000004:00080000:1.0:1787365239.762255:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 2 committed 00000020:00080000:1.0:1787365239.762283:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f27bbb94cc0 refcount 2 committed 0 result 0 batchid 1 00000020:00080000:1.0:1787365239.762288:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f27b6b14600 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f27bbb94480 00000020:00080000:1.0:1787365239.762292:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f27b6b14700 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f27baff6800 00000020:00080000:0.0:1787365239.762420:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 1 committed batchid 0 00000100:00100000:3.0:1787365239.762468:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787365239.762488:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bae85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024480512:0@lo:6:osp-syn-0-0.0 00000020:00080000:0.0:1787365239.762541:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 0 00000100:00100000:3.0:1787365239.762557:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365239.762832:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024480512 00000100:00100000:0.0:1787365239.762839:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024480512 00000100:00100000:0.0:1787365239.762898:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:0.0:1787365239.762907:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1874188024480512:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787365239.762930:0:10260:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:2 count 1 00002000:00010000:0.0:1787365239.762959:0:10260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x2:0x0] initial LVB size: 13, mtime: 0x6a890776, atime: 0x6a890776, ctime: 0x6a890776, blocks: 0x1 00010000:00010000:0.0:1787365239.762967:0:10260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077aa4fad/0x872d29295eb47076 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.762982:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=356s v=(0 0) 00010000:00010000:0.0:1787365239.762987:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x2:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365239.762993:0:10260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000077aa4fad/0x872d29295eb47076 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.763007:0:10260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000077aa4fad/0x872d29295eb47076 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.763018:0:10260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000077aa4fad/0x872d29295eb47076 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.763026:0:10260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000077aa4fad/0x872d29295eb47076 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365239.763046:0:10260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787365239.764330:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787365239.764341:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000077aa4fad/0x872d29295eb47076 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365239.764345:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1874188024480512:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1425us (1775us total) trans 4294967301 rc 0/0 00010000:00010000:2.0:1787365239.764361:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030a00 already unused, calling callback (ffffffffc1672420) 00000100:00100000:0.0:1787365239.764365:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00010000:00010000:2.0:1787365239.764374:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000077aa4fad/0x872d29295eb47076 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365239.764386:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000077aa4fad/0x872d29295eb47076 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365239.764405:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000077aa4fad/0x872d29295eb47076 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365239.764412:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000077aa4fad/0x872d29295eb47076 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x2:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365239.764432:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365239.764434:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365239.764435:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787365239.764561:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f27bae85f80/2, rc 0, transno 4294967301 00000100:00100000:3.0:1787365239.764568:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bae85f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024480512:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787365240.036109:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365240.036266:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003475456 00000100:00100000:1.0:1787365240.036276:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003475456 00000100:00100000:1.0:1787365240.036357:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:1.0:1787365240.036368:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+12:10351:x1874188003475456:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:1.0:1787365240.036391:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365240.036410:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb4707d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989074 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.036499:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb47084 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.036513:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb47084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.036527:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb47084 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787365240.036557:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:1.0:1787365240.036841:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb4707d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989074 expref: 15 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.036859:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb47084 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989074 expref: 14 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.036868:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:1.0:1787365240.036871:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787365240.036874:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798114c00, rc 0) 00000100:00100000:1.0:1787365240.036926:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:10351:x1874188003475456:12345-192.168.203.13@tcp:101:cat.0 Request processed in 560us (824us total) trans 4294967331 rc 0/0 00000100:00100000:1.0:1787365240.036933:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00080000:0.0:1787365240.037017:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365240.042841:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365240.043268:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003475584 00000100:00100000:1.0:1787365240.043278:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003475584 00000100:00100000:1.0:1787365240.043344:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:1.0:1787365240.043355:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:2361:x1874188003475584:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365240.043372:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365240.043397:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb47084 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989074 expref: 14 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.043418:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:1.0:1787365240.043423:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365240.043480:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e1ac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:2361:x1874188003475584:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 126us (648us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365240.043489:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:2.0:1787365240.043506:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365240.043570:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003475840 00000100:00100000:1.0:1787365240.043575:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003475840 00000100:00100000:1.0:1787365240.043606:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:2.0:1787365240.043612:0:5836:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 2 min 2 max 80 00000100:00100000:1.0:1787365240.043614:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:10351:x1874188003475840:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:2.0:1787365240.043651:0:5836:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_002' 00000100:00100000:1.0:1787365240.043843:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:10351:x1874188003475840:12345-192.168.203.13@tcp:35:cat.0 Request processed in 229us (337us total) trans 4294967332 rc 0/0 00000100:00100000:1.0:1787365240.043850:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:2.0:1787365240.113664:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365240.113761:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003476096 00000100:00100000:0.0:1787365240.113770:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003476096 00000100:00100000:0.0:1787365240.113824:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:0.0:1787365240.113834:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:10357:x1874188003476096:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:0.0:1787365240.113867:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365240.113870:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:0.0:1787365240.113898:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb46fe3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898904a expref: 14 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.113917:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:0.0:1787365240.113922:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787365240.113935:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb47092 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898907b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.114040:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47099 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.114052:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb47061 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898906d expref: 14 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.114060:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47099 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.114091:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb47061 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898906d expref: 14 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.114123:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb47061 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898906d expref: 14 pid: 6704 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365240.114136:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2787323100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874188024480640:192.168.203.13@tcp:104: 00000100:00100000:0.0:1787365240.114237:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2684531840 going to sleep for 11 seconds 00000100:00100000:3.0:1787365240.118083:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365240.118199:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2787323100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874188024480640:192.168.203.13@tcp:104: 00010000:00010000:0.0:1787365240.118247:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47099 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365240.118324:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003476224 00000100:00100000:1.0:1787365240.118331:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003476224 00010000:00010000:1.0:1787365240.118374:0:8434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb47061 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898906d expref: 15 pid: 6704 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365240.118412:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:1.0:1787365240.118421:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+15:2362:x1874188003476224:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365240.118435:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365240.118442:0:8434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb47061 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898906d expref: 15 pid: 6704 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.118455:0:8434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb47061 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898906d expref: 15 pid: 6704 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.118478:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb47061 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898906d expref: 15 pid: 6704 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.118492:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:1.0:1787365240.118497:0:8434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47099 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.118524:0:8434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47099 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.118532:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47099 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.118559:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365240.118612:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae87480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:2362:x1874188003476224:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 191us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365240.118619:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00010000:00010000:0.0:1787365240.118727:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47099 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.118735:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47099 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365240.118751:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 13 00010000:00010000:0.0:1787365240.118903:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb47092 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898907b expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.118919:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47099 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898907b expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.118926:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:0.0:1787365240.118930:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787365240.118932:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780030800, rc 0) 00000100:00100000:0.0:1787365240.118956:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:10357:x1874188003476096:12345-192.168.203.13@tcp:101:dd.0 Request processed in 5125us (5302us total) trans 4294967333 rc 0/0 00000100:00100000:0.0:1787365240.118972:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:2.0:1787365240.123849:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365240.123931:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003476480 00000100:00100000:1.0:1787365240.123951:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003476480 00000100:00100000:1.0:1787365240.124008:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:1.0:1787365240.124019:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:10357:x1874188003476480:12345-192.168.203.13@tcp:36:dd.0 00010000:00010000:1.0:1787365240.124352:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb470a7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.124369:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb470a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.124380:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb470a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787365240.124431:0:6704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967334 00000004:00010000:1.0:1787365240.124455:0:6704:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000005835066d reply state 000000004f1f129c transno 4294967335 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb470a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365240.124462:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787365240.124557:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+17:10357:x1874188003476480:12345-192.168.203.13@tcp:36:dd.0 Request processed in 539us (717us total) trans 4294967335 rc 0/0 00000100:00100000:1.0:1787365240.124574:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000020:00080000:1.0:1787365240.124579:0:6704:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787365240.134265:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb470a7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.134283:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb470a7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.134292:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb470a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.134298:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365240.134304:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb470a7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.134311:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb470a7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.134345:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:1.0:1787365240.134349:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365240.134354:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb470a7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.134360:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb470a7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.180183:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365240.465204:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365240.465302:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003476608 00000100:00100000:3.0:1787365240.465311:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003476608 00000100:00100000:3.0:1787365240.465390:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:3.0:1787365240.465399:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+16:10371:x1874188003476608:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:3.0:1787365240.465423:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365240.465444:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb470ae lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989082 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365240.465506:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb470b5 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365240.465520:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb470b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365240.465531:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb470b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365240.465561:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb470bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365240.465568:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb470bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365240.465574:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb470bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365240.466166:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb470c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365240.466179:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47099 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898907b expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365240.466188:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb470c3 lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365240.466231:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47099 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898907b expref: 17 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365240.466245:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47099 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898907b expref: 17 pid: 5833 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365240.466259:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bae85180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874188024480768:192.168.203.13@tcp:104: 00000100:00100000:3.0:1787365240.466395:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b64c6300 going to sleep for 11 seconds 00000100:00100000:0.0:1787365240.470192:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bae85180 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874188024480768:192.168.203.13@tcp:104: 00010000:00010000:0.0:1787365240.470231:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb470c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365240.470869:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365240.471133:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003476864 00000100:00100000:1.0:1787365240.471142:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003476864 00000100:00100000:1.0:1787365240.471199:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:1.0:1787365240.471210:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:5596:x1874188003476864:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787365240.471552:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+19:5596:x1874188003476864:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 343us (685us total) trans 4294967336 rc 0/0 00000100:00100000:1.0:1787365240.471559:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1787365240.480962:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365240.481116:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003476992 00000100:00100000:0.0:1787365240.481126:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003476992 00010000:00010000:0.0:1787365240.481164:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47099 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898907b expref: 19 pid: 5833 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365240.481204:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:0.0:1787365240.481214:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+19:2361:x1874188003476992:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787365240.481238:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365240.481245:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47099 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898907b expref: 19 pid: 5833 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.481259:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47099 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898907b expref: 19 pid: 5833 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.481281:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47099 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898907b expref: 19 pid: 5833 timeout: 457 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.481297:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:0.0:1787365240.481302:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb470c3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.481344:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb470c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.481352:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb470c3 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.481386:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365240.481443:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae84000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:2361:x1874188003476992:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 230us (499us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365240.481451:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00010000:00010000:1.0:1787365240.482184:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb470c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.482195:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb470c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787365240.482253:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787365240.482258:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787365240.482302:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb470c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.482316:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb470c3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.482342:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb470b5 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.482349:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb470b5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.482357:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb470b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.482362:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365240.482366:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb470b5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.482374:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb470b5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.482396:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:1.0:1787365240.482400:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365240.482404:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb470b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.482410:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb470b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.482424:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb470bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.482430:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb470bc lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.482435:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb470bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.482441:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365240.482443:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb470bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.482450:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb470bc lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.482458:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f2789e48000) 00010000:00010000:1.0:1787365240.482460:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365240.482463:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb470bc lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.482468:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb470bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.482516:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb470ae lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989082 expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.482531:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb470c3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989082 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.482538:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:1.0:1787365240.482540:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787365240.482543:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45200, rc 0) 00000100:00100000:1.0:1787365240.482589:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+17:10371:x1874188003476608:12345-192.168.203.13@tcp:101:stat.0 Request processed in 17190us (17392us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365240.482596:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:3.0:1787365240.599388:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365240.599494:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003477248 00000100:00100000:1.0:1787365240.599503:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003477248 00000100:00100000:1.0:1787365240.599564:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:1.0:1787365240.599574:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+17:10377:x1874188003477248:12345-192.168.203.13@tcp:36:truncate.0 00010000:00010000:1.0:1787365240.599657:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365240.599684:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb470c3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989082 expref: 17 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.599702:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:1.0:1787365240.599706:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787365240.599918:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb470ca lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.599931:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb470ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.599962:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb470ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787365240.600013:0:6704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967337 00000004:00010000:1.0:1787365240.600038:0:6704:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4997a42 reply state 00000000055b227d transno 4294967338 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb470ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365240.600046:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787365240.600148:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae86680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+19:10377:x1874188003477248:12345-192.168.203.13@tcp:36:truncate.0 Request processed in 575us (769us total) trans 4294967338 rc 0/0 00000100:00100000:1.0:1787365240.600156:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00000020:00080000:1.0:1787365240.600161:0:6704:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787365240.607515:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb470ca lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365240.607533:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb470ca lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365240.607565:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb470ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365240.607571:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365240.607575:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb470ca lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365240.607584:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb470ca lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365240.607601:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:2.0:1787365240.607605:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365240.607609:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb470ca lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365240.607615:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb470ca lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365240.756086:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365240.756463:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003477376 00000100:00100000:0.0:1787365240.756473:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003477376 00000100:00100000:0.0:1787365240.756536:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:0.0:1787365240.756546:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:10391:x1874188003477376:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:0.0:1787365240.756570:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365240.756604:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb470d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989089 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.756706:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb470d8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.756721:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb470d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.756732:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb470d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.756748:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb470df lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.756768:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb470df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.756775:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb470df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.757658:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb470e6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.757670:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb470e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.757678:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb470e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365240.757714:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00000004:00200000:0.0:1787365240.757718:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787365240.757740:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb470e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.757751:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb470e6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.757760:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb470d8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.757766:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb470d8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.757774:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb470d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.757789:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365240.757794:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb470d8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.757803:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb470d8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.757815:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:0.0:1787365240.757818:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365240.757823:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb470d8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.757830:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb470d8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.757842:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb470df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.757849:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb470df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.757854:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb470df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.757859:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780031c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365240.757862:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb470df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.757868:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb470df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.757884:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f278a0ad300) 00010000:00010000:0.0:1787365240.757886:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365240.757889:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb470df lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.757895:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb470df lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.757928:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb470d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989089 expref: 20 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.759248:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb470e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989089 expref: 19 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365240.759261:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:0.0:1787365240.759264:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787365240.759267:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27c2045400, rc 0) 00000100:00100000:0.0:1787365240.759341:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae84700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+19:10391:x1874188003477376:12345-192.168.203.13@tcp:101:stat.0 Request processed in 2795us (3262us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365240.759349:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:0.0:1787365240.891274:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365240.897785:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003477632 00000100:00100000:1.0:1787365240.897802:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003477632 00000100:00100000:1.0:1787365240.897896:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:1.0:1787365240.897907:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+19:10401:x1874188003477632:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1787365240.897927:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365240.897949:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb470ed lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989090 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787365240.898385:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:1.0:1787365240.898561:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb470ed lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989090 expref: 21 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.898576:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2789e48c00) 00010000:00010000:1.0:1787365240.898579:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787365240.898584:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb470ed lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989090 expref: 21 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365240.898968:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115600, rc 0) 00000100:00100000:1.0:1787365240.899175:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787323100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+20:10401:x1874188003477632:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1269us (7909us total) trans 4294967339 rc 301/301 00000100:00100000:1.0:1787365240.899185:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:3.0:1787365240.905883:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365240.905969:0:11946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003477888 00000100:00100000:1.0:1787365240.905978:0:11946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003477888 00000100:00100000:1.0:1787365240.906049:0:11946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1787365240.906067:0:11946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+20:10401:x1874188003477888:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1787365240.906510:0:11946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:10401:x1874188003477888:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 451us (635us total) trans 4294967340 rc 0/0 00000100:00100000:1.0:1787365240.906519:0:11946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:3.0:1787365241.025771:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365241.025890:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003478144 00000100:00100000:1.0:1787365241.025901:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003478144 00000100:00100000:1.0:1787365241.025974:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:1.0:1787365241.025984:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:10407:x1874188003478144:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1787365241.026009:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365241.026030:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb470fb lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989097 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.026127:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47102 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.026143:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb470e6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989089 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.026171:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47102 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.026203:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb470e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989089 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.026228:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb470e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989089 expref: 22 pid: 5833 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365241.026241:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279808dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874188024480896:192.168.203.13@tcp:104: 00000100:00100000:1.0:1787365241.026345:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5d9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365241.029422:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279808dc00 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874188024480896:192.168.203.13@tcp:104: 00010000:00010000:1.0:1787365241.029452:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47102 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365241.032265:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365241.032481:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003478272 00000100:00100000:1.0:1787365241.032490:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003478272 00010000:00010000:1.0:1787365241.032531:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb470e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989089 expref: 23 pid: 5833 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365241.032581:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:1.0:1787365241.032591:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+23:2362:x1874188003478272:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365241.032606:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365241.032613:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb470e6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989089 expref: 23 pid: 5833 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.032667:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb470e6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989089 expref: 23 pid: 5833 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.032692:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb470e6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989089 expref: 23 pid: 5833 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.032710:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:1.0:1787365241.032715:0:8435:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47102 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.032724:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47102 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.032731:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47102 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.032769:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365241.032821:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+22:2362:x1874188003478272:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 232us (566us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365241.032828:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00010000:00010000:2.0:1787365241.033515:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47102 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.033527:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47102 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365241.033546:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 1234567 00010000:00010000:2.0:1787365241.033756:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb470fb lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989097 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.033775:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47102 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989097 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.033797:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:2.0:1787365241.033800:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787365241.033803:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115e00, rc 0) 00000100:00100000:2.0:1787365241.033841:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae85180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+22:10407:x1874188003478144:12345-192.168.203.13@tcp:101:bash.0 Request processed in 7858us (8079us total) trans 4294967341 rc 0/0 00000100:00100000:2.0:1787365241.033848:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:3.0:1787365241.036083:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365241.037706:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003478528 00000100:00100000:1.0:1787365241.037719:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003478528 00000100:00100000:1.0:1787365241.037782:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:1.0:1787365241.037792:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+22:10407:x1874188003478528:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:1.0:1787365241.038044:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47110 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.038062:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47110 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.038086:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47110 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787365241.038145:0:6704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967342 00000004:00010000:1.0:1787365241.038168:0:6704:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000006e7c4b82 reply state 0000000046a87287 transno 4294967343 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47110 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365241.038177:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787365241.038279:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+25:10407:x1874188003478528:12345-192.168.203.13@tcp:36:bash.0 Request processed in 487us (2204us total) trans 4294967343 rc 0/0 00000100:00100000:1.0:1787365241.038286:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00000020:00080000:1.0:1787365241.038290:0:6704:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:0.0:1787365241.045263:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365241.045359:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003478656 00000100:00100000:2.0:1787365241.045368:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003478656 00000100:00100000:2.0:1787365241.045426:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:2.0:1787365241.045436:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+25:10407:x1874188003478656:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1787365241.045458:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365241.045480:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb47117 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898909e expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.045563:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb4711e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.045579:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47102 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989097 expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.045588:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47110 lrc: 2/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.045596:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb4711e lrc: 5/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.045613:0:5833:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47110 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.045687:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47102 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989097 expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.045701:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47102 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989097 expref: 26 pid: 5834 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365241.045717:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf92680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874188024481024:192.168.203.13@tcp:104: 00000100:00100000:2.0:1787365241.045795:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473fa80 going to sleep for 11 seconds 00010000:00010000:1.0:1787365241.045867:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47110 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.045876:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47110 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000020 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.045883:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47110 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.045889:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365241.045893:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47110 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000020 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.045900:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47110 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000020 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.045915:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:1.0:1787365241.045918:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365241.045927:0:3297:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb4711e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.045936:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47110 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.045942:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47110 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000020 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365241.047807:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf92680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874188024481024:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365241.047836:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb4711e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365241.052681:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365241.052773:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003478784 00000100:00100000:2.0:1787365241.052783:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003478784 00010000:00010000:2.0:1787365241.052825:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47102 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989097 expref: 26 pid: 5834 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365241.052873:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:2.0:1787365241.052882:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+26:2362:x1874188003478784:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787365241.052897:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365241.052903:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47102 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989097 expref: 26 pid: 5834 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.052916:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47102 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989097 expref: 26 pid: 5834 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.052965:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47102 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989097 expref: 26 pid: 5834 timeout: 458 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.052979:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:2.0:1787365241.052984:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb4711e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.052992:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb4711e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.052999:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb4711e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.053033:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365241.053084:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b54380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+25:2362:x1874188003478784:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 203us (413us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365241.053091:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00010000:00010000:3.0:1787365241.053513:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb4711e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.053523:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb4711e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365241.053567:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:3.0:1787365241.053573:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787365241.053600:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb4711e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.053669:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb47117 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898909e expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.053687:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb4711e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898909e expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.053695:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:3.0:1787365241.053698:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787365241.053701:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cc800, rc 0) 00000100:00100000:3.0:1787365241.053731:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787322300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+24:10407:x1874188003478656:12345-192.168.203.13@tcp:101:bash.0 Request processed in 8296us (8478us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365241.053738:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:3.0:1787365241.060800:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365241.060955:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003479040 00000100:00100000:2.0:1787365241.060964:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003479040 00000100:00100000:2.0:1787365241.061074:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:2.0:1787365241.061084:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278ac6e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+24:10407:x1874188003479040:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:2.0:1787365241.061326:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278ac6e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+25:10407:x1874188003479040:12345-192.168.203.13@tcp:35:bash.0 Request processed in 243us (534us total) trans 4294967344 rc 0/0 00000100:00100000:2.0:1787365241.061347:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00010000:00010000:2.0:1787365241.202968:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365241.209795:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365241.209931:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003479296 00000100:00100000:3.0:1787365241.209941:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003479296 00000100:00100000:3.0:1787365241.210015:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:3.0:1787365241.210024:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+25:10417:x1874188003479296:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1787365241.210047:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365241.210067:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb47125 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989890a5 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365241.210324:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:3.0:1787365241.210484:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb47125 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890a5 expref: 27 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.210498:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2789e48c00) 00010000:00010000:3.0:1787365241.210501:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787365241.210505:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb47125 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890a5 expref: 27 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.210518:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45600, rc 0) 00000100:00100000:3.0:1787365241.210778:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808dc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+26:10417:x1874188003479296:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 754us (991us total) trans 4294967345 rc 301/301 00000100:00100000:3.0:1787365241.210787:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:0.0:1787365241.220480:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365241.220573:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003479424 00000100:00100000:3.0:1787365241.220582:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003479424 00000100:00100000:3.0:1787365241.220665:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:3.0:1787365241.220675:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+26:10417:x1874188003479424:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:3.0:1787365241.220755:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb47133 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.220772:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb47133 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.220801:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb47133 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.220817:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb4713a lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.220824:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb4713a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.220830:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb4713a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221233:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47141 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221243:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221250:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787365241.221299:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221310:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb47133 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221316:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb47133 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221323:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb47133 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221340:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365241.221344:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb47133 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221351:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb47133 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221363:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:3.0:1787365241.221366:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365241.221371:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb47133 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221376:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb47133 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221389:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb4713a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221395:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb4713a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221400:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb4713a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221405:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365241.221408:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb4713a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221413:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb4713a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221431:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f2789e48600) 00010000:00010000:3.0:1787365241.221434:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365241.221436:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb4713a lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221442:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb4713a lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221455:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47141 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221461:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47141 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221467:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47141 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221472:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45e00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365241.221475:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47141 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221480:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47141 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221487:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:3.0:1787365241.221489:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365241.221491:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47141 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.221496:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47141 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365241.221794:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b55c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+26:10417:x1874188003479424:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 1118us (1320us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365241.221803:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:0.0:1787365241.235059:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365241.235146:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003479680 00000100:00100000:2.0:1787365241.235157:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003479680 00000100:00100000:2.0:1787365241.235236:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:2.0:1787365241.235246:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+26:10417:x1874188003479680:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1787365241.235875:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+27:10417:x1874188003479680:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 629us (825us total) trans 4294967346 rc 0/0 00000100:00100000:2.0:1787365241.235884:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:1.0:1787365241.294210:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365241.294358:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003479936 00000100:00100000:2.0:1787365241.294368:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003479936 00000100:00100000:2.0:1787365241.294429:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:2.0:1787365241.294439:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+27:10420:x1874188003479936:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1787365241.294461:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365241.294481:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb47148 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989890ac expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.294554:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb4714f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.294569:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb4714f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.294580:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb4714f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.294594:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb47156 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.294601:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb47156 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.294608:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb47156 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.295013:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb4715d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.295022:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb4715d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.295030:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb4715d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365241.295039:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787365241.295112:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb4714f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.295119:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb4714f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.295125:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb4714f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.295130:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cc600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365241.295134:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb4714f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.295141:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb4714f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.295152:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:2.0:1787365241.295155:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365241.295158:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb4714f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.295186:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc600/0x872d29295eb4714f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.295197:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb47156 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.295202:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb47156 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.295208:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb47156 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.295220:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cd400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365241.295223:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb47156 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.295228:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb47156 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.295235:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f27988df400) 00010000:00010000:2.0:1787365241.295237:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365241.295240:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb47156 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.295245:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb47156 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.295280:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb47148 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890ac expref: 30 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.295290:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb4715d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890ac expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.295304:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:2.0:1787365241.295306:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787365241.295309:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cca00, rc 0) 00000100:00100000:2.0:1787365241.295366:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+29:10420:x1874188003479936:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 928us (1165us total) trans 4294967347 rc 0/0 00000100:00100000:2.0:1787365241.295373:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:0.0:1787365241.299231:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365241.299278:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365241.299443:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003480192 00000100:00100000:1.0:1787365241.299453:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003480192 00000100:00100000:1.0:1787365241.299518:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:1.0:1787365241.299528:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+29:2362:x1874188003480192:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365241.299542:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365241.299569:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb4715d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890ac expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.299588:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:1.0:1787365241.299594:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365241.299681:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+28:2362:x1874188003480192:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 154us (402us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365241.299690:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:3.0:1787365241.299899:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003480064 00000100:00100000:3.0:1787365241.299904:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003480064 00000100:00100000:3.0:1787365241.299940:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:3.0:1787365241.299948:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+28:10420:x1874188003480064:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:3.0:1787365241.300005:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb4716b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.300069:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb4716b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.300081:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb4716b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.300107:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb4716b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.300113:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb4716b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.300121:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb4716b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.300126:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45e00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365241.300130:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb4716b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.300137:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb4716b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.300154:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:3.0:1787365241.300157:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787365241.300161:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb4716b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.300179:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb4716b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365241.300240:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+28:10420:x1874188003480064:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 292us (1025us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365241.300246:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:0.0:1787365241.304962:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365241.305065:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003480448 00000100:00100000:2.0:1787365241.305076:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003480448 00000100:00100000:2.0:1787365241.305138:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:2.0:1787365241.305148:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+28:10420:x1874188003480448:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1787365241.305440:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+29:10420:x1874188003480448:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 291us (485us total) trans 4294967348 rc 0/0 00000100:00100000:2.0:1787365241.305448:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:1.0:1787365241.533431:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365241.533611:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003480704 00000100:00100000:2.0:1787365241.533620:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003480704 00000100:00100000:2.0:1787365241.533696:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:2.0:1787365241.533706:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+29:10438:x1874188003480704:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:2.0:1787365241.533734:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365241.533756:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47172 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989890b3 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.533866:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb47179 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.533883:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb47179 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.533909:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb47179 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365241.533922:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787365241.534065:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47172 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890b3 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.534084:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb47179 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890b3 expref: 31 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.534093:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:2.0:1787365241.534096:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787365241.534099:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb709800, rc 0) 00000100:00100000:2.0:1787365241.534161:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+31:10438:x1874188003480704:12345-192.168.203.13@tcp:101:cat.0 Request processed in 456us (737us total) trans 4294967349 rc 0/0 00000100:00100000:2.0:1787365241.534168:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:3.0:1787365241.560447:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365241.561250:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003480832 00000100:00100000:2.0:1787365241.561261:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003480832 00000100:00100000:2.0:1787365241.561336:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:2.0:1787365241.561348:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+31:10439:x1874188003480832:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1787365241.561373:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365241.561394:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47187 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989890ba expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.561458:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb4718e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.561490:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb4718e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.561502:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb4718e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365241.561706:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:2.0:1787365241.561710:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365241.561777:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb4718e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.561802:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47187 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890ba expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.561818:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb4718e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890ba expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.561826:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:2.0:1787365241.561828:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787365241.561831:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb708400, rc 0) 00000100:00100000:2.0:1787365241.561896:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+32:10439:x1874188003480832:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 550us (1457us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365241.561903:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:0.0:1787365241.566106:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365241.566203:0:11946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003481216 00000100:00100000:1.0:1787365241.566222:0:11946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003481216 00000100:00100000:1.0:1787365241.566277:0:11946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:1.0:1787365241.566294:0:11946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+32:10439:x1874188003481216:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1787365241.566606:0:11946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+33:10439:x1874188003481216:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 313us (509us total) trans 4294967350 rc 0/0 00000100:00100000:1.0:1787365241.566615:0:11946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:1.0:1787365241.568723:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365241.568799:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003481344 00000100:00100000:0.0:1787365241.568807:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003481344 00000100:00100000:0.0:1787365241.568861:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:0.0:1787365241.568870:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+33:10439:x1874188003481344:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:0.0:1787365241.568886:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787365241.568912:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb4711e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898909e expref: 33 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365241.568933:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb47179 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890b3 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365241.568954:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb47022 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898905f expref: 31 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365241.568964:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:0.0:1787365241.568973:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365241.569020:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808ce00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+30:10439:x1874188003481344:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 151us (307us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365241.569027:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:3.0:1787365241.571276:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365241.571443:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003481472 00000100:00100000:2.0:1787365241.571453:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003481472 00000100:00100000:2.0:1787365241.571513:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:2.0:1787365241.571522:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+30:10439:x1874188003481472:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:2.0:1787365241.571778:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47195 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.571814:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47195 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.571826:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47195 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787365241.576123:0:5835:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787365241.578016:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 64 off8256 00000040:00080000:2.0:1787365241.578122:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].1, 136 off8328 00000100:00100000:2.0:1787365241.578324:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+30:10439:x1874188003481472:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 6797us (7051us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365241.578344:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00000040:00080000:2.0:1787365241.586986:0:11664:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787365241.586996:0:11664:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787365241.587048:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:2.0:1787365241.587055:0:11664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787365241.587179:0:11664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf92a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11664:1874188024481152:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787365241.587309:0:11664:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365241.600781:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365241.600965:0:5844:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003481600 00000100:00100000:1.0:1787365241.600975:0:5844:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003481600 00000100:00100000:1.0:1787365241.601025:0:5844:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:1.0:1787365241.601035:0:5844:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+31:10442:x1874188003481600:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 00000100:00100000:1.0:1787365241.601123:0:5844:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+31:10442:x1874188003481600:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 Request processed in 89us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365241.601131:0:5844:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:2.0:1787365241.601581:0:11664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf92a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11664:1874188024481152:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787365241.608983:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365241.609330:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003481728 00000100:00100000:2.0:1787365241.609340:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003481728 00000100:00100000:2.0:1787365241.609398:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:2.0:1787365241.609409:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+30:10442:x1874188003481728:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787365241.609440:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787365241.609556:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+30:10442:x1874188003481728:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 149us (581us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365241.609580:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:3.0:1787365241.612719:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365241.613327:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003481856 00000100:00100000:1.0:1787365241.613337:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003481856 00000100:00100000:1.0:1787365241.613396:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:1.0:1787365241.613405:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+30:10441:x1874188003481856:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1787365241.613423:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365241.613444:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb4719c lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989890c1 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.613525:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb471a3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.613538:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb471a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.613549:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb471a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.613574:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb471aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.613581:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb471aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.613587:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb471aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.614233:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb471b1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.614245:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb471b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.614254:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb471b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365241.614496:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365241.614594:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003481984 00000100:00100000:2.0:1787365241.614601:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003481984 00000100:00100000:2.0:1787365241.614656:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:2.0:1787365241.614666:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+32:10442:x1874188003481984:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787365241.614707:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb471b8 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.614718:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb471b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.614726:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb471b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.614738:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708e00/0x872d29295eb471bf lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.614745:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708e00/0x872d29295eb471bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.614752:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708e00/0x872d29295eb471bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.614770:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb471c6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.614778:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb471c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.614784:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb471c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365241.614825:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:2.0:1787365241.614830:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365241.614842:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb471c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.614852:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb471b8 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.614859:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb471b8 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.614865:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb471b8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.614871:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365241.614875:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb471b8 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.614882:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb471b8 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.614893:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f27988dfd00) 00010000:00010000:2.0:1787365241.614896:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365241.614901:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb471b8 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.614907:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb471b8 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.614919:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708e00/0x872d29295eb471bf lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.614943:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708e00/0x872d29295eb471bf lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.614950:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708e00/0x872d29295eb471bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.614954:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708e00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365241.614957:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708e00/0x872d29295eb471bf lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.614963:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708e00/0x872d29295eb471bf lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.614972:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x3c15db59 (ffff9f27988df800) 00010000:00010000:2.0:1787365241.614975:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365241.614977:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708e00/0x872d29295eb471bf lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.614983:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708e00/0x872d29295eb471bf lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x3c15db59 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.614998:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb471c6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.615004:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb471c6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.615010:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb471c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.615015:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365241.615025:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb471c6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.615032:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb471c6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.615040:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f27988df400) 00010000:00010000:2.0:1787365241.615042:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365241.615045:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb471c6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.615051:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb471c6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365241.615126:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+32:10442:x1874188003481984:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 461us (633us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365241.615135:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00000004:00200000:1.0:1787365241.615552:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00000004:00200000:1.0:1787365241.615556:0:6704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787365241.615573:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb471b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.615585:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb471b1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.615592:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb471a3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.615598:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb471a3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.615615:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb471a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.615620:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365241.615646:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb471a3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.615654:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb471a3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.615664:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:1.0:1787365241.615666:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365241.615669:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb471a3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.615675:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb471a3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.615686:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb471aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.615693:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb471aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.615698:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb471aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.615702:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365241.615704:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb471aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.615720:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb471aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.615727:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f2784761000) 00010000:00010000:1.0:1787365241.615729:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365241.615732:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb471aa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.615737:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb471aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.615767:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb4719c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890c1 expref: 32 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.615778:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb471b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890c1 expref: 31 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.615785:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f27988df400) 00010000:00010000:1.0:1787365241.615786:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787365241.616049:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115200, rc 0) 00000100:00100000:1.0:1787365241.616130:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+31:10441:x1874188003481856:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 2725us (3419us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365241.616137:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:0.0:1787365241.625473:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365241.625679:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003482240 00000100:00100000:2.0:1787365241.625689:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003482240 00000100:00100000:2.0:1787365241.625744:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:2.0:1787365241.625754:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+31:10442:x1874188003482240:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365241.625774:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365241.625808:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb471cd lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989890c8 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.625902:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb471d4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.625916:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb471d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.625954:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb471d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365241.625967:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:2.0:1787365241.626065:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb471d4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.626072:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb471d4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.626079:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb471d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.626085:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365241.626089:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb471d4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.626096:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb471d4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.626107:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f27988df400) 00010000:00010000:2.0:1787365241.626110:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787365241.626114:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb471d4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.626119:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb471d4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.626156:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb471cd lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890c8 expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.626178:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f27988dfd00) 00010000:00010000:2.0:1787365241.626180:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787365241.626184:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb471cd lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890c8 expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.626194:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb708800, rc 0) 00000100:00100000:2.0:1787365241.626654:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+32:10442:x1874188003482240:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 873us (1162us total) trans 4294967351 rc 301/301 00000100:00100000:2.0:1787365241.626664:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:0.0:1787365241.636667:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365241.636755:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003482368 00000100:00100000:3.0:1787365241.636764:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003482368 00000100:00100000:3.0:1787365241.636825:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:3.0:1787365241.636834:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+32:10442:x1874188003482368:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787365241.636871:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x4:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787365241.636993:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+32:10442:x1874188003482368:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 160us (373us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365241.637001:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:1.0:1787365241.651508:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365241.655121:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003482624 00000100:00100000:2.0:1787365241.655134:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003482624 00000100:00100000:2.0:1787365241.655258:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:2.0:1787365241.655269:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+32:10442:x1874188003482624:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365241.655298:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365241.655301:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787365241.655328:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb4718e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890ba expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.655348:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:2.0:1787365241.655353:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787365241.655366:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb471e2 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989890cf expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787365241.656077:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x3:0x0], index 1: 0 00010000:00010000:2.0:1787365241.656302:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb471e9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.656324:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb471e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.656334:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb471e9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.656390:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb471e2 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890cf expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.656405:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb471e9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890cf expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.656412:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f27988df800) 00010000:00010000:2.0:1787365241.656415:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787365241.656418:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb709c00, rc 0) 00000100:00100000:2.0:1787365241.656488:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+33:10442:x1874188003482624:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1221us (4989us total) trans 4294967352 rc 0/0 00000100:00100000:2.0:1787365241.656497:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:0.0:1787365241.666607:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365241.668227:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003482880 00000100:00100000:3.0:1787365241.668240:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003482880 00000100:00100000:3.0:1787365241.673737:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:3.0:1787365241.673758:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+33:10442:x1874188003482880:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787365241.673816:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365241.673843:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb471e9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890cf expref: 33 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.673863:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f27988df800) 00010000:00010000:3.0:1787365241.673872:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787365241.673897:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb471f7 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.673910:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb471f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.673920:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb471f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.674069:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb471fe lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x1f6a8ebd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.674081:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb471fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1f6a8ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.674088:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb471fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1f6a8ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.674348:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb471f7 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.674356:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb471f7 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.674372:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb471f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.674379:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365241.674383:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb471f7 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.674390:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb471f7 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.674399:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:3.0:1787365241.674401:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365241.674405:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb471f7 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.674410:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb471f7 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.674420:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb471fe lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x1f6a8ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.674425:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb471fe lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1f6a8ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.674431:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb471fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1f6a8ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.674436:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45e00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365241.674439:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb471fe lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1f6a8ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.674454:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb471fe lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x1f6a8ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.674461:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x1f6a8ebd (ffff9f2789e48600) 00010000:00010000:3.0:1787365241.674464:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365241.674467:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb471fe lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1f6a8ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.674472:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb471fe lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x1f6a8ebd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365241.674603:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+32:10442:x1874188003482880:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 854us (8004us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787365241.674611:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:1.0:1787365241.694333:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365241.694436:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003483008 00000100:00100000:0.0:1787365241.694446:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003483008 00000100:00100000:0.0:1787365241.694510:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:0.0:1787365241.694520:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+32:10442:x1874188003483008:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787365241.694550:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365241.694573:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47205 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989890d6 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365241.694609:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb4720c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365241.694622:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb4720c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365241.694674:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb4720c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365241.694778:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47205 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890d6 expref: 34 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365241.694798:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb4720c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890d6 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365241.694806:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:0.0:1787365241.694809:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787365241.694812:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27c2045400, rc 0) 00000100:00100000:0.0:1787365241.694863:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+33:10442:x1874188003483008:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 345us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365241.694870:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:1.0:1787365241.703306:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365241.703402:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003483264 00000100:00100000:3.0:1787365241.703411:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003483264 00000100:00100000:3.0:1787365241.703467:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:3.0:1787365241.703475:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+33:10442:x1874188003483264:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787365241.703575:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47213 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.703593:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.703604:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787365241.703949:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].3, 88 off8408 00000004:00080000:3.0:1787365241.703960:0:6704:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 358868333854ns, next at 359868331130ns, rc = 0 00000004:00010000:3.0:1787365241.704053:0:6704:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f41f75cd reply state 000000003676e6c0 transno 4294967353 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365241.704063:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787365241.704158:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+35:10442:x1874188003483264:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 682us (859us total) trans 4294967353 rc 0/0 00000100:00100000:3.0:1787365241.704166:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 75 00010000:00010000:2.0:1787365241.708336:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47213 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.708353:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47213 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.708362:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47213 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.708369:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45e00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365241.708374:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47213 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.708408:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47213 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.708426:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:2.0:1787365241.708429:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787365241.708435:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47213 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.708441:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47213 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365241.717890:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365241.718336:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003483392 00000100:00100000:0.0:1787365241.718345:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003483392 00000100:00100000:0.0:1787365241.718408:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:0.0:1787365241.718428:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+34:10442:x1874188003483392:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787365241.718467:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365241.718487:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4721a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989890dd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365241.718545:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4721a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890dd expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365241.718559:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4721a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890dd expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365241.718578:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:0.0:1787365241.718582:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787365241.718585:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27c2045800, rc 0) 00000100:00100000:0.0:1787365241.718674:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+35:10442:x1874188003483392:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 257us (793us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365241.718681:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:1.0:1787365241.730123:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365241.730318:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003483520 00000100:00100000:2.0:1787365241.730327:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003483520 00000100:00100000:2.0:1787365241.730380:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:2.0:1787365241.730388:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:0+-99:2358:x1874188003483520:12345-192.168.203.13@tcp:8:lhsmtool_posix.0 00010000:00080000:2.0:1787365241.730436:0:6681:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp t0 exp 0000000000000000 cur 358 last 0 00000020:00000080:2.0:1787365241.730471:0:6681:0:(genops.c:1385:class_connect()) connect: client 8662a6a5-8ae3-4336-8479-3ba18dbc45ca, cookie 0x872d29295eb47221 00002000:00100000:2.0:1787365241.730484:0:6681:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 8662a6a5-8ae3-4336-8479-3ba18dbc45ca/ffff9f2789caf000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392e ocd_grant: 3407872 ocd_index: 0 ocd_group 0 00002000:00100000:2.0:1787365241.730510:0:6681:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:2.0:1787365241.730781:0:6681:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787365241.730810:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9f2789cac800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787365241.730874:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808c000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2358:x1874188003483520:12345-192.168.203.13@tcp:8:lhsmtool_posix.0 Request processed in 485us (761us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365241.730882:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:1.0:1787365241.753665:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365241.754149:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003483648 00000100:00100000:3.0:1787365241.754159:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003483648 00000100:00100000:3.0:1787365241.754297:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:3.0:1787365241.754307:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:0:x1874188003483648:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787365241.760772:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000001:00100000:0.0:1787365241.840234:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8662a6a5-8ae3-4336-8479-3ba18dbc45ca 00000001:00080000:0.0:1787365241.840255:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967301 is committed 00000100:00100000:2.0:1787365241.840512:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:0:x1874188003483648:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 86201us (86891us total) trans 4294967301 rc 0/0 00000100:00100000:2.0:1787365241.840540:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:0.0:1787365241.849412:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365241.849456:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003483904 00000100:00100000:0.0:1787365241.849465:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003483904 00000100:00100000:0.0:1787365241.849513:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:0.0:1787365241.849522:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+35:10442:x1874188003483904:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787365241.849774:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+36:10442:x1874188003483904:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 252us (370us total) trans 4294967354 rc 0/0 00000100:00100000:0.0:1787365241.849792:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:3.0:1787365241.862010:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365241.862147:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003484160 00000100:00100000:0.0:1787365241.862156:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003484160 00000100:00100000:0.0:1787365241.862219:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:0.0:1787365241.862231:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+36:10442:x1874188003484160:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787365241.862341:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+36:10442:x1874188003484160:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 112us (340us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365241.862348:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:0.0:1787365241.868883:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365241.868987:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003484288 00000100:00100000:2.0:1787365241.868997:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003484288 00000100:00100000:2.0:1787365241.869161:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:2.0:1787365241.869173:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+36:10442:x1874188003484288:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365241.869192:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365241.869220:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb47228 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989890e4 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.869294:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb4722f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.869309:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb4722f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.869323:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb4722f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365241.869359:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365241.869377:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb4722f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.869403:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb47228 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890e4 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.869417:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb4722f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890e4 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365241.869424:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:2.0:1787365241.869434:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787365241.869438:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb708a00, rc 0) 00000100:00100000:2.0:1787365241.869500:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+37:10442:x1874188003484288:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 329us (623us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365241.869507:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:3.0:1787365241.872953:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365241.873066:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003484416 00000100:00100000:0.0:1787365241.873076:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003484416 00000100:00100000:0.0:1787365241.873134:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:0.0:1787365241.873143:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2361:x1874188003484416:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787365241.873160:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365241.873181:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47236 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989890eb expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787365241.873207:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a890779, blocks: 0x1 00010000:00010000:0.0:1787365241.873238:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=359s v=(0 0) 00010000:00010000:0.0:1787365241.873242:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365241.873252:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47236 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890eb expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365241.873272:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47236 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890eb expref: 6 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365241.873315:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27c2045a00, rc 0) 00000100:00100000:0.0:1787365241.873370:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2361:x1874188003484416:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 228us (423us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365241.873377:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:0.0:1787365241.904478:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365241.906783:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003484672 00000100:00100000:2.0:1787365241.906796:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003484672 00000100:00100000:0.0:1787365241.909524:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:0.0:1787365241.909537:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+37:10442:x1874188003484672:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787365241.909660:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+37:10442:x1874188003484672:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 125us (5191us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365241.909668:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:0.0:1787365241.920588:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365241.921083:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003484800 00000100:00100000:1.0:1787365241.921093:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003484800 00000100:00100000:1.0:1787365241.921149:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:1.0:1787365241.921159:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:10442:x1874188003484800:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787365241.921177:0:10260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365241.921199:0:10260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb4723d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989890f2 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.921240:0:10260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47236 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890eb expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.921249:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365241.921253:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365241.921259:0:10260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb4723d lrc: 4/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890f2 expref: 7 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.921301:0:10260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47236 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890eb expref: 7 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.921316:0:10260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47236 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890eb expref: 7 pid: 6681 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365241.921330:0:10260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279808c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10260:1874188024481280:192.168.203.13@tcp:104: 00000100:00100000:1.0:1787365241.921517:0:10260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5d300 going to sleep for 11 seconds 00000100:00100000:1.0:1787365241.923726:0:10260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279808c700 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10260:1874188024481280:192.168.203.13@tcp:104: 00010000:00010000:1.0:1787365241.923773:0:10260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb4723d lrc: 3/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890f2 expref: 7 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365241.923792:0:10260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798114000, rc 0) 00000100:00100000:1.0:1787365241.923849:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:10442:x1874188003484800:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 2691us (3270us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365241.923858:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:0.0:1787365241.924826:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365241.924876:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003484928 00000100:00100000:3.0:1787365241.924885:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003484928 00010000:00010000:3.0:1787365241.924919:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47236 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890eb expref: 7 pid: 6681 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365241.924960:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:3.0:1787365241.924968:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e18050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2361:x1874188003484928:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365241.924984:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365241.925006:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47236 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890eb expref: 7 pid: 6681 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.925021:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47236 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890eb expref: 7 pid: 6681 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.925062:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47236 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890eb expref: 7 pid: 6681 timeout: 459 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.925077:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365241.925081:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365241.925088:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb4723d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890f2 expref: 6 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.925096:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb4723d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890f2 expref: 6 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365241.925130:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb4723d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890f2 expref: 6 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365241.925143:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6be5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5820:1874188024481408:192.168.203.13@tcp:105: 00000100:00100000:3.0:1787365241.925227:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b64c6c00 going to sleep for 11 seconds 00000100:00100000:3.0:1787365241.932055:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6be5f80 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0001_UUID:5820:1874188024481408:192.168.203.13@tcp:105: 00010000:00010000:3.0:1787365241.932086:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365241.932144:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e18050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2361:x1874188003484928:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 7175us (7321us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365241.932154:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:3.0:1787365241.936315:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365241.936464:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003485056 00000100:00100000:1.0:1787365241.936474:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003485056 00002000:00100000:1.0:1787365241.936523:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9f27b6be5c00 x1874188003485056/t0(0) o4->8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp:147/0 lens 504/0 e 0 to 0 dl 1787365252 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787365241.936534:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f27b6be5c00 with x1874188003485056 ext(0->8) 00002000:00010000:1.0:1787365241.936540:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f27b6be5c00 00000100:00100000:1.0:1787365241.936850:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1787365241.936863:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2361:x1874188003485056:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787365241.937785:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2361:x1874188003485056:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 923us (1476us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787365241.937795:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00002000:00100000:1.0:1787365241.937804:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x3:0x0] (0->8) req@ffff9f27b6be5c00 x1874188003485056/t4294967302(0) o4->8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp:147/0 lens 504/448 e 0 to 0 dl 1787365252 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787365241.937815:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f27b6be5c00 with x1874188003485056 ext(0->8) 00002000:00010000:1.0:1787365241.937820:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f27b6be5c00 00000100:00100000:1.0:1787365241.942098:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365241.942184:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003485184 00000100:00100000:2.0:1787365241.942193:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003485184 00000100:00100000:2.0:1787365241.942267:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:2.0:1787365241.942277:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+37:10442:x1874188003485184:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000001:00080000:1.0:1787365242.003154:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967354 is committed 00000020:00080000:1.0:1787365242.003198:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 1 batchid updated 00000004:00080000:1.0:1787365242.003267:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 4 committed 00000020:00080000:2.0:1787365242.003662:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1787365242.003674:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:1.0:1787365242.003844:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787365242.003866:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279808ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024481536:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787365242.003942:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365242.004709:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:10442:x1874188003485184:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 62429us (62614us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365242.004720:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:0.0:1787365242.004754:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024481536 00000100:00100000:0.0:1787365242.004761:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024481536 00000100:00100000:0.0:1787365242.004812:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:0.0:1787365242.004820:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024481536:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787365242.004980:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787365242.004985:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787365241 00002000:00010000:0.0:1787365242.004987:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787365242.004990:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787365241 -> 1787365241 00002000:00010000:0.0:1787365242.004992:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787365242.005049:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874188024481536:12345-0@lo:2:osp-syn-1-0.0 Request processed in 231us (1108us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787365242.005056:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000004:00080000:0.0:1787365242.005097:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f279808ce00/2, rc 0, transno 4294967303 00000100:00100000:0.0:1787365242.005104:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279808ce00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024481536:0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1787365242.005543:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787365242.009770:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365242.010262:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003485312 00000100:00100000:3.0:1787365242.010274:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003485312 00000100:00100000:3.0:1787365242.010427:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:3.0:1787365242.010438:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2361:x1874188003485312:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000001:00080000:0.0:1787365242.086675:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967303 is committed 00000001:00080000:0.0:1787365242.086691:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967302 is committed 00000100:00100000:3.0:1787365242.086922:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2361:x1874188003485312:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 76480us (77153us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365242.086946:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:2.0:1787365242.102504:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365242.102901:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003485568 00000100:00100000:0.0:1787365242.102912:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003485568 00000100:00100000:0.0:1787365242.102981:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:0.0:1787365242.102992:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:10442:x1874188003485568:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787365242.103042:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365242.103067:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb4722f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890e4 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.103085:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:0.0:1787365242.103090:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787365242.103118:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47244 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.103131:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47244 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.103140:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47244 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787365242.103412:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000044e68721 reply state 000000009dd979aa transno 4294967355 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47244 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365242.103435:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787365242.103527:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf92680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:10442:x1874188003485568:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 537us (1033us total) trans 4294967355 rc 0/0 00000100:00100000:0.0:1787365242.103535:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00080000:2.0:1787365242.104090:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:1.0:1787365242.105820:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47244 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.105835:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47244 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.105842:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47244 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.105849:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2044400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365242.105853:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47244 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.105861:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47244 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.105883:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:1.0:1787365242.105887:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365242.105891:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47244 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.105897:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47244 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365242.114560:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365242.114709:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003485696 00000100:00100000:0.0:1787365242.114720:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003485696 00000100:00100000:0.0:1787365242.114775:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:0.0:1787365242.114786:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2360:x1874188003485696:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787365242.115035:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:0.0:1787365242.115039:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787365241 -> 1787365240 00002000:00010000:0.0:1787365242.115042:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787365238 00002000:00010000:0.0:1787365242.115044:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787365241 -> 1787365240 00002000:00010000:0.0:1787365242.115046:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787365242.115107:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf93800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2360:x1874188003485696:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 323us (557us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787365242.115115:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:0.0:1787365242.127689:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365242.127815:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003485952 00000100:00100000:1.0:1787365242.127824:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003485952 00000100:00100000:1.0:1787365242.127880:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:1.0:1787365242.127891:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:10442:x1874188003485952:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787365242.127955:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4724b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.127972:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb4720c lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890d6 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.127982:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4724b lrc: 4/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.128015:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb4720c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890d6 expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.128029:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb4720c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890d6 expref: 13 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365242.128043:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbf8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874188024481664:192.168.203.13@tcp:104: 00000100:00100000:1.0:1787365242.128123:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5da80 going to sleep for 11 seconds 00000100:00100000:2.0:1787365242.141742:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365242.142043:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003486080 00000100:00100000:0.0:1787365242.142052:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003486080 00010000:00010000:0.0:1787365242.142096:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb4720c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890d6 expref: 14 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365242.142143:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:0.0:1787365242.142154:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:2362:x1874188003486080:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787365242.142169:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365242.142190:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb4720c lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890d6 expref: 14 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.142205:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb4720c lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890d6 expref: 14 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.142242:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:0.0:1787365242.142247:0:8435:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4724b lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.142257:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4724b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.142265:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4724b lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.142284:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365242.142349:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:2362:x1874188003486080:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 197us (616us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365242.142357:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00010000:00010000:1.0:1787365242.143271:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb4720c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x6:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890d6 expref: 13 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365242.143290:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbf8a80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874188024481664:192.168.203.13@tcp:104: 00010000:00010000:1.0:1787365242.143415:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4724b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.148677:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4724b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.148693:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4724b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.148720:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4724b lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.148726:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4724b lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.148742:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4724b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.148748:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798115800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365242.148752:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4724b lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.148758:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4724b lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.148774:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:0.0:1787365242.148776:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787365242.148780:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4724b lrc: 2/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.148786:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4724b lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365242.148873:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+12:10442:x1874188003485952:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 20979us (21190us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787365242.148885:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:2.0:1787365242.163431:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365242.163551:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003486208 00000100:00100000:0.0:1787365242.163561:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003486208 00000100:00100000:0.0:1787365242.163616:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:0.0:1787365242.163654:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2362:x1874188003486208:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787365242.163697:0:10260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47252 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.163717:0:10260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb4723d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890f2 expref: 7 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.163735:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365242.163739:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787365242.163744:0:10260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47252 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.163779:0:10260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb4723d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890f2 expref: 7 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.163793:0:10260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb4723d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890f2 expref: 7 pid: 10260 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365242.163808:0:10260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6cb3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10260:1874188024481792:192.168.203.13@tcp:104: 00000100:00100000:0.0:1787365242.163885:0:10260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278fd56f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787365242.168724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365242.168824:0:10260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6cb3800 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10260:1874188024481792:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365242.168852:0:10260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47252 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365242.170173:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003486336 00000100:00100000:3.0:1787365242.170185:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003486336 00010000:00010000:3.0:1787365242.170242:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb4723d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890f2 expref: 8 pid: 10260 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365242.170294:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:3.0:1787365242.170304:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2361:x1874188003486336:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365242.170320:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365242.170354:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb4723d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890f2 expref: 8 pid: 10260 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.170370:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb4723d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890f2 expref: 8 pid: 10260 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.170394:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb4723d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890f2 expref: 8 pid: 10260 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.170411:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787365242.170415:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787365242.170421:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47252 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.170448:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47252 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.170470:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365242.170523:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf8a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2361:x1874188003486336:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 220us (1810us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365242.170531:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00010000:00010000:2.0:1787365242.172378:0:10260:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47252 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.172397:0:10260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47252 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.172460:0:10260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47252 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.172468:0:10260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47252 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.172476:0:10260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47252 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.172483:0:10260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2045a00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:2.0:1787365242.172488:0:10260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47252 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.172497:0:10260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47252 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.172519:0:10260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47252 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.172527:0:10260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dd1f1fb1/0x872d29295eb47252 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365242.172615:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2362:x1874188003486208:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 8986us (9189us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365242.172642:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:0.0:1787365242.184651:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365242.184770:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003486592 00000100:00100000:1.0:1787365242.184793:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003486592 00000100:00100000:1.0:1787365242.184853:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:1.0:1787365242.184863:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+12:10442:x1874188003486592:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787365242.184943:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb47259 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.184960:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb47259 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.184971:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb47259 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.185170:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb47260 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.185181:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4721a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890dd expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.185189:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb47260 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.185234:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4721a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890dd expref: 13 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.185249:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4721a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890dd expref: 13 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365242.185262:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874188024481920:192.168.203.13@tcp:104: 00000100:00100000:1.0:1787365242.185333:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abe5da80 going to sleep for 11 seconds 00000100:00100000:3.0:1787365242.188615:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365242.188669:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003486720 00000100:00100000:3.0:1787365242.188677:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003486720 00010000:00010000:3.0:1787365242.188716:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4721a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890dd expref: 14 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365242.188758:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:3.0:1787365242.188767:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:2362:x1874188003486720:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365242.188782:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365242.188790:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4721a lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890dd expref: 14 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.188803:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4721a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890dd expref: 14 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.188826:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:3.0:1787365242.188832:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb47260 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.188857:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb47260 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.188865:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb47260 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.188900:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365242.188959:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:2362:x1874188003486720:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 193us (354us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365242.188967:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00010000:00010000:1.0:1787365242.190458:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4721a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890dd expref: 13 pid: 5834 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365242.190494:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874188024481920:192.168.203.13@tcp:104: 00010000:00010000:1.0:1787365242.190516:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb47260 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.190524:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb47260 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.190529:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb47260 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787365242.190726:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967356 00000001:00080000:1.0:1787365242.190877:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967357 00000001:00080000:1.0:1787365242.190924:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967358 00000100:00100000:1.0:1787365242.191008:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874188024482048:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787365242.191065:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365242.191100:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2684531f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787365242.191520:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024482048 00000100:00100000:3.0:1787365242.191527:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024482048 00000100:00100000:3.0:1787365242.191581:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787365242.191590:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1874188024482048:12345-0@lo:1000:mdt00_000.0 00000100:00100000:3.0:1787365242.191687:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1874188024482048:12345-0@lo:1000:mdt00_000.0 Request processed in 98us (622us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365242.191694:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787365242.192825:0:5833:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:1.0:1787365242.192834:0:5833:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f279808ce00, transno 4294967303 00000100:00100000:1.0:1787365242.192856:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874188024482048:0@lo:1000:mdt00_000.0 00000001:00080000:1.0:1787365242.193365:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967359 00000100:00100000:1.0:1787365242.193440:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874188024482176:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787365242.193606:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365242.193658:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f26845313c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365242.193687:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024482176 00000100:00100000:1.0:1787365242.193692:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024482176 00000100:00100000:1.0:1787365242.193727:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787365242.193734:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+5:5833:x1874188024482176:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787365242.193911:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1874188024482176:12345-0@lo:1000:mdt00_000.0 Request processed in 176us (304us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787365242.193919:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787365242.193958:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874188024482176:0@lo:1000:mdt00_000.0 00010000:00010000:1.0:1787365242.193992:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb47260 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.194002:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb47260 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.194010:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb47260 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.194017:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365242.194022:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb47260 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.194030:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb47260 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.194046:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:1.0:1787365242.194050:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787365242.194055:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb47260 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.194061:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb47260 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x6:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.194097:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47195 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.194112:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47195 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.194117:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47195 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.194122:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365242.194125:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47195 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.194131:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47195 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.194140:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f27988df400) 00010000:00010000:1.0:1787365242.194142:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787365242.194145:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47195 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.194151:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47195 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.194170:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb47267 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.194184:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb471b1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890c1 expref: 16 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.194193:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb47267 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.194228:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb471b1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890c1 expref: 16 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.194247:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb471b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890c1 expref: 16 pid: 6704 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365242.194258:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874188024482304:192.168.203.13@tcp:104: 00000100:00100000:1.0:1787365242.196204:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6230600 going to sleep for 11 seconds 00000100:00100000:2.0:1787365242.207558:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365242.207608:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003486848 00000100:00100000:2.0:1787365242.207617:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003486848 00010000:00010000:2.0:1787365242.207668:0:8434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb471b1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890c1 expref: 17 pid: 6704 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365242.207703:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:2.0:1787365242.207712:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+17:2362:x1874188003486848:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787365242.207725:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365242.207731:0:8434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb471b1 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890c1 expref: 17 pid: 6704 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.207744:0:8434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb471b1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890c1 expref: 17 pid: 6704 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.207765:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f27988df400) 00010000:00010000:2.0:1787365242.207769:0:8434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb47267 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.207779:0:8434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb47267 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.207787:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb47267 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.207805:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365242.207855:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf91500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+17:2362:x1874188003486848:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 145us (307us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365242.207863:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00010000:00010000:1.0:1787365242.212653:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb471b1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890c1 expref: 16 pid: 6704 timeout: 459 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365242.212678:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c7800 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874188024482304:192.168.203.13@tcp:104: 00010000:00010000:1.0:1787365242.212703:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb47267 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.212713:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb47267 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.212719:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb47267 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.212732:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb47267 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.212739:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb47267 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.212745:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb47267 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.212751:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365242.212771:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb47267 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.212779:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb47267 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.212796:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f27988df400) 00010000:00010000:1.0:1787365242.212799:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365242.212803:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb47267 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.212810:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb47267 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.212821:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb47259 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.212827:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb47259 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.212833:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb47259 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.212839:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798115c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365242.212842:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb47259 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.212847:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb47259 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.212855:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f27988df400) 00010000:00010000:1.0:1787365242.212858:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787365242.212868:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb47259 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.212873:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb47259 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365242.213112:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+15:10442:x1874188003486592:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 28249us (28498us total) trans 4294967360 rc 0/0 00000100:00100000:1.0:1787365242.213122:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 83 00000020:00080000:1.0:1787365242.213128:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787365242.216067:0:11664:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787365242.216074:0:11664:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787365242.216107:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787365242.216124:0:11664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787365242.228983:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365242.230365:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365242.231077:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003487104 00000100:00100000:3.0:1787365242.231088:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003487104 00000100:00100000:3.0:1787365242.231262:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:3.0:1787365242.231272:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+15:10442:x1874188003487104:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787365242.233150:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x6:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787365242.233287:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967361 00010000:00010000:2.0:1787365242.233351:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb4726e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.233369:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb4726e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.233381:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb4726e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.233389:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb4726e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.233396:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb4726e lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.233402:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb4726e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.233425:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787365242.233524:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+17:10442:x1874188003487104:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 2250us (3163us total) trans 4294967362 rc 0/0 00000100:00100000:2.0:1787365242.233534:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000020:00080000:2.0:1787365242.233539:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787365242.235043:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365242.235055:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb4726e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.235066:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708c00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365242.235069:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb4726e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.235087:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb4726e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.235103:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x6:0x0].0x0 (ffff9f27988df800) 00010000:00010000:3.0:1787365242.235106:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787365242.235110:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb4726e lrc: 1/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.235116:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb4726e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x6:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.235141:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365242.235143:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365242.235145:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787365242.533409:0:11986:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787365242.533419:0:11986:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787365242.533473:0:11986:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 2 count 2 00000040:00080000:0.0:1787365242.533971:0:11986:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787365242.715710:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365242.715747:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003487360 00000100:00100000:0.0:1787365242.715768:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003487360 00000100:00100000:0.0:1787365242.715819:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:0.0:1787365242.715829:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+17:10462:x1874188003487360:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1787365242.715854:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365242.715874:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47275 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989890f9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.716126:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044000/0x872d29295eb4727c lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.716141:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044000/0x872d29295eb4727c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.716152:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044000/0x872d29295eb4727c lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365242.716163:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00010000:00010000:0.0:1787365242.716341:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47275 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890f9 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.716360:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044000/0x872d29295eb4727c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890f9 expref: 19 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.716369:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:0.0:1787365242.716371:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787365242.716374:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27c2044000, rc 0) 00000100:00100000:0.0:1787365242.717089:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+19:10462:x1874188003487360:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1258us (1383us total) trans 4294967363 rc 0/0 00000100:00100000:0.0:1787365242.717099:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:2.0:1787365242.723543:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365242.724257:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003487488 00000100:00100000:1.0:1787365242.724266:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003487488 00000100:00100000:1.0:1787365242.724315:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:1.0:1787365242.724324:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+19:10462:x1874188003487488:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:1.0:1787365242.724397:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4728a lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.725549:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4728a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.725566:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4728a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.725588:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47291 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.725596:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.725602:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.725913:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47298 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.725922:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.725929:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787365242.725972:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.727648:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4728a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.727660:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4728a lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.727667:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4728a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.727673:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365242.727677:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4728a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.727685:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4728a lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.727699:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:1.0:1787365242.727702:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365242.727707:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4728a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.727720:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4728a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.727734:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47291 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.727739:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47291 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.727744:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47291 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.727749:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365242.727752:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47291 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.727757:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47291 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.727765:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f2784761000) 00010000:00010000:1.0:1787365242.727767:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365242.727770:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47291 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.727776:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47291 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.727792:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47298 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.727798:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47298 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.727810:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.727815:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365242.727818:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47298 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.727824:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47298 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.727832:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f2784761800) 00010000:00010000:1.0:1787365242.727834:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365242.727837:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47298 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.727843:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47298 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365242.727950:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf92d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+19:10462:x1874188003487488:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 3621us (4412us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365242.727960:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:0.0:1787365242.807258:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365242.812392:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003487744 00000100:00100000:2.0:1787365242.812407:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003487744 00000100:00100000:2.0:1787365242.813878:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:2.0:1787365242.813890:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+19:10465:x1874188003487744:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1787365242.813910:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365242.813946:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb4729f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989100 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814034:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472a6 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814051:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814063:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814079:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb472ad lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814087:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb472ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814092:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb472ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814450:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb472b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814459:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb472b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814481:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb472b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365242.814491:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:2.0:1787365242.814587:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472a6 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814605:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472a6 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814611:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814617:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365242.814621:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472a6 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814663:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472a6 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814675:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:2.0:1787365242.814678:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365242.814682:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814688:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814699:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb472ad lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814705:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb472ad lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814711:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb472ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814716:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365242.814724:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb472ad lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814730:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb472ad lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814738:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f27988dfc00) 00010000:00010000:2.0:1787365242.814740:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365242.814743:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb472ad lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814748:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb472ad lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814788:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb4729f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989100 expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814801:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb472b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989100 expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.814808:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f27988dfa00) 00010000:00010000:2.0:1787365242.814810:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787365242.814813:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb709e00, rc 0) 00000100:00100000:2.0:1787365242.814879:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:10465:x1874188003487744:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 991us (7630us total) trans 4294967364 rc 0/0 00000100:00100000:2.0:1787365242.814888:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:1.0:1787365242.828947:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365242.829098:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003487872 00000100:00100000:3.0:1787365242.829107:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003487872 00000100:00100000:3.0:1787365242.829167:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:3.0:1787365242.829178:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:10465:x1874188003487872:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:3.0:1787365242.829259:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb472c2 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.829275:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb472c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.829285:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb472c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.829310:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb472c2 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.829316:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb472c2 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.829336:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb472c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.829342:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365242.829346:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb472c2 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.829352:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb472c2 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.829364:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f27988dfa00) 00010000:00010000:3.0:1787365242.829368:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787365242.829372:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb472c2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.829378:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb472c2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365242.829457:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:10465:x1874188003487872:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 281us (532us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365242.829464:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:3.0:1787365242.842576:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365242.842790:0:11946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003488128 00000100:00100000:0.0:1787365242.842800:0:11946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003488128 00000100:00100000:0.0:1787365242.842870:0:11946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1787365242.842881:0:11946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278ac6c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:10465:x1874188003488128:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1787365242.843137:0:11946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278ac6c450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+22:10465:x1874188003488128:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 257us (570us total) trans 4294967365 rc 0/0 00000100:00100000:0.0:1787365242.843146:0:11946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1787365242.902413:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365242.902527:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003488384 00000100:00100000:2.0:1787365242.902538:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003488384 00000100:00100000:2.0:1787365242.902598:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:2.0:1787365242.902608:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+22:9991:x1874188003488384:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1787365242.902679:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365242.902702:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb472c9 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989107 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.902812:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.902827:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb472b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989100 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.902836:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472d0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.902869:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb472b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989100 expref: 23 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.902883:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb472b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989100 expref: 23 pid: 5834 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365242.902895:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf91c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874188024482432:192.168.203.13@tcp:104: 00000100:00100000:2.0:1787365242.903190:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2797aecb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787365242.907680:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365242.907814:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf91c00 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874188024482432:192.168.203.13@tcp:104: 00010000:00010000:0.0:1787365242.907850:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365242.908438:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003488512 00000100:00100000:1.0:1787365242.908446:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003488512 00010000:00010000:1.0:1787365242.908486:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb472b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989100 expref: 24 pid: 5834 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365242.908572:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:1.0:1787365242.908583:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+24:2362:x1874188003488512:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365242.908621:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365242.908658:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb472b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989100 expref: 24 pid: 5834 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.908670:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb472b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989100 expref: 24 pid: 5834 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.908692:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb472b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989100 expref: 24 pid: 5834 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.908706:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f27988dfa00) 00010000:00010000:1.0:1787365242.908710:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472d0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.908718:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.908725:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472d0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365242.908744:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365242.908810:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf90380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+23:2362:x1874188003488512:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 228us (1139us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365242.908818:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00010000:00010000:0.0:1787365242.910157:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.910171:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472d0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365242.910191:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 9 00010000:00010000:0.0:1787365242.910364:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb472c9 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989107 expref: 24 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.910382:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989107 expref: 23 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.910391:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f27988dfa00) 00010000:00010000:0.0:1787365242.910393:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787365242.910408:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb708200, rc 0) 00000100:00100000:0.0:1787365242.910469:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+23:9991:x1874188003488384:12345-192.168.203.13@tcp:101:bash.0 Request processed in 7862us (8065us total) trans 4294967366 rc 0/0 00000100:00100000:0.0:1787365242.910478:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:2.0:1787365242.914446:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365242.914543:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003488768 00000100:00100000:3.0:1787365242.914552:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003488768 00000100:00100000:3.0:1787365242.914737:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:3.0:1787365242.914816:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+23:9991:x1874188003488768:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:3.0:1787365242.915195:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb472de lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.915246:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb472de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.915258:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb472de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787365242.915310:0:6704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967367 00000004:00010000:3.0:1787365242.915442:0:6704:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000083b645ff reply state 00000000975d7685 transno 4294967368 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb472de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365242.915451:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:3.0:1787365242.915505:0:6704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967368 00000100:00100000:3.0:1787365242.915793:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+27:9991:x1874188003488768:12345-192.168.203.13@tcp:36:bash.0 Request processed in 1044us (1455us total) trans 4294967369 rc 0/0 00000100:00100000:3.0:1787365242.915801:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 89 00000020:00080000:3.0:1787365242.915805:0:6704:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00000100:00100000:2.0:1787365242.919600:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365242.920269:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003488896 00000100:00100000:3.0:1787365242.920279:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003488896 00000100:00100000:3.0:1787365242.920340:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:3.0:1787365242.920349:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+27:9991:x1874188003488896:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1787365242.920372:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365242.920395:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb472e5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898910e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.920453:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb472e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898910e expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.920467:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb472e5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898910e expref: 28 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365242.920507:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f27988dfa00) 00010000:00010000:3.0:1787365242.920511:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787365242.920514:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45600, rc 0) 00000100:00100000:3.0:1787365242.920690:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+28:9991:x1874188003488896:12345-192.168.203.13@tcp:101:bash.0 Request processed in 340us (1097us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365242.920698:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 90 00010000:00010000:0.0:1787365242.924535:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb472de lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.924554:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb472de lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.924562:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb472de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.924567:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365242.924571:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb472de lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.924579:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb472de lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.924597:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f27988dfa00) 00010000:00010000:0.0:1787365242.924600:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365242.924605:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb472de lrc: 2/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365242.924611:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb472de lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365242.928562:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365242.928898:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003489024 00000100:00100000:2.0:1787365242.928907:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003489024 00000100:00100000:2.0:1787365242.929075:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:2.0:1787365242.929085:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:9991:x1874188003489024:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1787365242.929115:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365242.929134:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000008e796b9/0x872d29295eb472ec lrc: 2/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989115 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787365242.929160:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a890778, atime: 0x6a890776, ctime: 0x6a890778, blocks: 0xb 00010000:00010000:2.0:1787365242.929179:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=360s v=(0 0) 00010000:00010000:2.0:1787365242.929183:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365242.929191:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000008e796b9/0x872d29295eb472ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989115 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.929218:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000008e796b9/0x872d29295eb472ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989115 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365242.929230:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb708c00, rc 0) 00000100:00100000:2.0:1787365242.929291:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb1880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:9991:x1874188003489024:12345-192.168.203.13@tcp:101:bash.0 Request processed in 207us (737us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365242.929298:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:1.0:1787365242.932334:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365242.932408:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003489152 00000100:00100000:0.0:1787365242.932418:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003489152 00002000:00010000:0.0:1787365242.932457:0:6686:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1787365242.932473:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f27b63c6300 with x1874188003489152 ext(0->18446744073709551615) 00002000:00010000:0.0:1787365242.932485:0:6686:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f27b63c6300. 00000100:00100000:0.0:1787365242.932520:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:0.0:1787365242.932531:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2361:x1874188003489152:12345-192.168.203.13@tcp:10:bash.0 00002000:00010000:0.0:1787365242.932856:0:6686:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:0.0:1787365242.932860:0:6686:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb mtime from disk: 1787365240 -> 1787365242 00002000:00010000:0.0:1787365242.932863:0:6686:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb atime from disk: 1787365238 -> 1787365238 00002000:00010000:0.0:1787365242.932865:0:6686:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb ctime from disk: 1787365240 -> 1787365242 00002000:00010000:0.0:1787365242.932867:0:6686:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x3:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:0.0:1787365242.932917:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2361:x1874188003489152:12345-192.168.203.13@tcp:10:bash.0 Request processed in 388us (591us total) trans 4294967306 rc 0/0 00000100:00100000:0.0:1787365242.932935:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00002000:00010000:0.0:1787365242.932939:0:6686:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/3 (0->18446744073709551615) 00002000:00100000:0.0:1787365242.932942:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f27b63c6300 with x1874188003489152 ext(0->18446744073709551615) 00002000:00010000:0.0:1787365242.932947:0:6686:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f27b63c6300. 00000100:00100000:0.0:1787365243.026023:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365243.026139:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003489280 00000100:00100000:1.0:1787365243.026149:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003489280 00000100:00100000:1.0:1787365243.026219:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:1.0:1787365243.026229:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+27:10479:x1874188003489280:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:1.0:1787365243.026320:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb472f3 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026356:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb472f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026370:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb472f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026385:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb472fa lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026393:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb472fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026399:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb472fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026719:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47301 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026729:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026736:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787365243.026775:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026787:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb472f3 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026804:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb472f3 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026811:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb472f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026816:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365243.026820:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb472f3 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026828:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb472f3 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026840:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:1.0:1787365243.026843:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365243.026847:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb472f3 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026854:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb472f3 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026866:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb472fa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026872:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb472fa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026878:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb472fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026883:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365243.026892:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb472fa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026898:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb472fa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026906:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f2784761800) 00010000:00010000:1.0:1787365243.026909:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365243.026912:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb472fa lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026918:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb472fa lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026932:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47301 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026938:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47301 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026944:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47301 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026949:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365243.026952:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47301 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026957:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47301 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026965:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f27988dfa00) 00010000:00010000:1.0:1787365243.026967:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365243.026978:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47301 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.026984:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114200/0x872d29295eb47301 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365243.027086:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+27:10479:x1874188003489280:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 857us (1071us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365243.027095:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:2.0:1787365243.087382:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365243.089476:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003489536 00000100:00100000:0.0:1787365243.089491:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003489536 00000100:00100000:0.0:1787365243.089561:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 92 00000100:00100000:0.0:1787365243.089571:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+27:10482:x1874188003489536:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1787365243.089591:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365243.089614:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47308 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898911c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.089727:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4730f lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.089760:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4730f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.089773:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4730f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.089789:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47316 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.089796:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.089804:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.090576:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4731d lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.090590:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4731d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.090599:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4731d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365243.090609:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 0 00010000:00010000:0.0:1787365243.090722:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4730f lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.090730:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4730f lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.090738:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4730f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.090750:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2044400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365243.090755:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4730f lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.090763:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4730f lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.090775:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:0.0:1787365243.090778:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365243.090782:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4730f lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.090789:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4730f lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.090803:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47316 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.090809:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47316 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.090815:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47316 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.090821:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2045a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365243.090824:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47316 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.090843:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47316 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.090862:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f278a0ad200) 00010000:00010000:0.0:1787365243.090865:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365243.090868:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47316 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.090875:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47316 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.094510:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47308 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898911c expref: 30 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.094530:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4731d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898911c expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.094540:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f27988dfa00) 00010000:00010000:0.0:1787365243.094555:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787365243.094560:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27c2045800, rc 0) 00000100:00100000:0.0:1787365243.094669:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf91880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+29:10482:x1874188003489536:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 5097us (7300us total) trans 4294967370 rc 0/0 00000100:00100000:0.0:1787365243.094679:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 92 00000100:00100000:2.0:1787365243.099807:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365243.099907:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003489664 00000100:00100000:1.0:1787365243.099916:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003489664 00000100:00100000:1.0:1787365243.100012:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:1.0:1787365243.100030:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+29:10482:x1874188003489664:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:1.0:1787365243.100109:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4732b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.100126:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472d0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989107 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.100135:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4732b lrc: 4/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.100168:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989107 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.100182:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989107 expref: 29 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365243.100195:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874188024482560:192.168.203.13@tcp:104: 00000100:00100000:1.0:1787365243.100302:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6230600 going to sleep for 11 seconds 00000100:00100000:1.0:1787365243.104828:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365243.105046:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003489920 00000100:00100000:3.0:1787365243.105055:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003489920 00000100:00100000:3.0:1787365243.105105:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:3.0:1787365243.105114:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+30:5597:x1874188003489920:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787365243.105425:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+31:5597:x1874188003489920:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 312us (606us total) trans 4294967371 rc 0/0 00000100:00100000:3.0:1787365243.105433:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:2.0:1787365243.110231:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c7b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874188024482560:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365243.110264:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4732b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365243.114757:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365243.114952:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003490048 00000100:00100000:3.0:1787365243.114961:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003490048 00010000:00010000:3.0:1787365243.115001:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989107 expref: 31 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365243.115150:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:3.0:1787365243.115161:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+31:2361:x1874188003490048:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365243.115177:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365243.115184:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472d0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989107 expref: 31 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.115197:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472d0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989107 expref: 31 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.115245:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708200/0x872d29295eb472d0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x4:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989107 expref: 31 pid: 5835 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.115261:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f27988dfa00) 00010000:00010000:3.0:1787365243.115266:0:8435:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4732b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.115276:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4732b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.115284:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4732b lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.115415:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365243.115479:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf90e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+30:2361:x1874188003490048:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 319us (730us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365243.115487:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00010000:00010000:1.0:1787365243.117105:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4732b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.117119:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4732b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.117151:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4732b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.117158:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4732b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.117164:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4732b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.117170:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365243.117174:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4732b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.117181:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4732b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.117195:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f27988dfa00) 00010000:00010000:1.0:1787365243.117198:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787365243.117213:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4732b lrc: 2/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.117220:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb4732b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365243.117370:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+29:10482:x1874188003489664:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 17346us (17568us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365243.117380:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:2.0:1787365243.123966:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365243.124091:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003490304 00000100:00100000:1.0:1787365243.124100:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003490304 00000100:00100000:1.0:1787365243.124160:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:1.0:1787365243.124170:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+29:10482:x1874188003490304:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1787365243.124408:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+30:10482:x1874188003490304:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 239us (449us total) trans 4294967372 rc 0/0 00000100:00100000:1.0:1787365243.124417:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00010000:00010000:0.0:1787365243.250837:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365243.255961:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365243.256129:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003490560 00000100:00100000:3.0:1787365243.256139:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003490560 00000100:00100000:3.0:1787365243.256209:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:3.0:1787365243.256220:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+30:10493:x1874188003490560:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:3.0:1787365243.256244:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365243.256262:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47332 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989123 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.256336:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47339 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.256360:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47339 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.256371:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47339 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.256387:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47340 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.256394:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.256400:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.257954:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47347 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.257970:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.257980:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47347 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365243.257991:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x4:0x0]: returning size 8 00010000:00010000:3.0:1787365243.258083:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47339 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.258092:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47339 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.258098:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47339 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.258114:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365243.258118:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47339 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.258125:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47339 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.258138:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:3.0:1787365243.258141:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365243.258145:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47339 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.258151:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47339 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.258166:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47340 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.258172:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47340 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.258178:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47340 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.258183:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365243.258186:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47340 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.258191:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47340 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.258221:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f2789e48600) 00010000:00010000:3.0:1787365243.258224:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365243.258227:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47340 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.258233:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47340 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.258281:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47332 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989123 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.258294:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47347 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989123 expref: 32 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.258300:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f27988dfa00) 00010000:00010000:3.0:1787365243.258303:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787365243.258305:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45e00, rc 0) 00000100:00100000:3.0:1787365243.258371:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+32:10493:x1874188003490560:12345-192.168.203.13@tcp:101:cat.0 Request processed in 2153us (2419us total) trans 4294967373 rc 0/0 00000100:00100000:3.0:1787365243.258379:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:0.0:1787365243.262416:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365243.262462:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365243.262496:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365243.262571:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003490944 00000100:00100000:3.0:1787365243.262580:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003490944 00000100:00100000:3.0:1787365243.262681:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00100000:3.0:1787365243.262692:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2359:x1874188003490944:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365243.262766:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2359:x1874188003490944:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 76us (269us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365243.262774:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00080000:0.0:1787365243.262904:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365243.263013:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003490816 00000100:00100000:2.0:1787365243.263018:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003490816 00000100:00100000:2.0:1787365243.263067:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:2.0:1787365243.263076:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2359:x1874188003490816:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1787365243.263107:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2359:x1874188003490816:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 34us (701us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365243.263114:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00080000:0.0:1787365243.263436:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787365243.263555:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003490688 00000100:00100000:1.0:1787365243.263569:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003490688 00000100:00100000:1.0:1787365243.263723:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 290 00000100:00100000:1.0:1787365243.263732:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2359:x1874188003490688:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365243.263779:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b7450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2359:x1874188003490688:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 48us (1316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365243.263787:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 290 00000100:00100000:0.0:1787365243.270317:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365243.270414:0:11946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003491200 00000100:00100000:1.0:1787365243.270423:0:11946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003491200 00000100:00100000:1.0:1787365243.270480:0:11946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:1.0:1787365243.270490:0:11946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+32:10493:x1874188003491200:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:1.0:1787365243.270761:0:11946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+33:10493:x1874188003491200:12345-192.168.203.13@tcp:35:cat.0 Request processed in 271us (453us total) trans 4294967374 rc 0/0 00000100:00100000:1.0:1787365243.270769:0:11946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:2.0:1787365243.301799:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365243.301898:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003491456 00000100:00100000:0.0:1787365243.301919:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003491456 00000100:00100000:0.0:1787365243.301981:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:0.0:1787365243.301989:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+33:10494:x1874188003491456:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:0.0:1787365243.302049:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787365243.302082:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47347 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989123 expref: 33 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.302108:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4731d lrc: 0/0,0 mode: --/PR res: [0x200000401:0x4:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898911c expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.302122:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb472e5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x4:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898910e expref: 31 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.302131:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f27988dfa00) 00010000:00010000:0.0:1787365243.302142:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787365243.302160:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47355 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.302173:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47355 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.302182:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47355 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.302195:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb4735c lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.302212:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb4735c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.302219:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb4735c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.302491:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47363 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.302500:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47363 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.302507:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47363 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787365243.303187:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].4, 64 off8472 00000004:00080000:0.0:1787365243.303197:0:5835:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 360467570350ns, next at 361467568065ns, rc = 0 00010000:00010000:0.0:1787365243.303278:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4736a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.303290:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4736a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.303298:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4736a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.303304:0:5835:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4736a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.303310:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4736a lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.303315:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4736a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.303338:0:5835:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787365243.303359:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47363 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.303371:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47363 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.303377:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47363 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.303383:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2045400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365243.303387:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47363 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.303395:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47363 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.303407:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ad800) 00010000:00010000:0.0:1787365243.303409:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787365243.303414:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47363 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.303421:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47363 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x4:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.303437:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47355 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.303443:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47355 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.303449:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47355 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.303454:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2044400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365243.303463:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47355 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.303469:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47355 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.303477:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:0.0:1787365243.303479:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365243.303482:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47355 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.303488:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47355 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787365243.303498:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000d3db05fa reply state 000000004274b6b3 transno 4294967375 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb4735c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365243.303507:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787365243.303686:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365243.303693:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4736a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.303699:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780031a00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365243.303702:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4736a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.303708:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4736a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.303718:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x4:0x0].0x0 (ffff9f278a0ad800) 00010000:00010000:3.0:1787365243.303720:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787365243.303723:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4736a lrc: 1/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.303729:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4736a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x4:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.303743:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365243.303745:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365243.303746:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365243.306443:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+32:10494:x1874188003491456:12345-192.168.203.13@tcp:36:rm.0 Request processed in 4442us (4642us total) trans 4294967375 rc 0/0 00000100:00100000:0.0:1787365243.306456:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 95 00010000:00010000:1.0:1787365243.317731:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb4735c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.317750:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb4735c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.317757:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb4735c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.317764:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2045a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365243.317771:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb4735c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.317779:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb4735c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.317796:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f278a0ad200) 00010000:00010000:1.0:1787365243.317799:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365243.317803:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb4735c lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.317810:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb4735c lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365243.381305:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365243.381670:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003491712 00000100:00100000:3.0:1787365243.381679:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003491712 00000100:00100000:3.0:1787365243.381737:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00100000:3.0:1787365243.381749:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+31:10500:x1874188003491712:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1787365243.381773:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365243.381794:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47371 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898912a expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.382167:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47378 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.382208:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47378 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.382220:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47378 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.382237:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb4737f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.382244:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb4737f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.382251:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb4737f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787365243.384402:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x3:0x0], index 0: 0 00010000:00010000:3.0:1787365243.384642:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47386 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.384659:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47386 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.384670:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47386 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.384708:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47378 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.384714:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47378 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.384725:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47378 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.384744:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365243.384748:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47378 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.384772:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47378 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.384786:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:3.0:1787365243.384789:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365243.384795:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47378 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.384802:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47378 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787365243.384817:0:6704:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000000c6a9e39 reply state 00000000cae555b4 transno 4294967376 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb4737f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365243.384826:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787365243.384859:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47371 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898912a expref: 34 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.384874:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47386 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898912a expref: 33 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.384893:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f2789e48d00) 00010000:00010000:3.0:1787365243.384896:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787365243.384899:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45200, rc 0) 00000100:00100000:3.0:1787365243.384982:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+34:10500:x1874188003491712:12345-192.168.203.13@tcp:101:bash.0 Request processed in 3235us (3685us total) trans 4294967376 rc 0/0 00000100:00100000:3.0:1787365243.384999:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 96 00010000:00010000:0.0:1787365243.392788:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb4737f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.392805:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb4737f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.392811:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb4737f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.392818:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365243.392822:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb4737f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.392851:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb4737f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.392877:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f2789e48600) 00010000:00010000:0.0:1787365243.392880:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365243.392885:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb4737f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.392891:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb4737f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365243.393951:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365243.394081:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003491840 00000100:00100000:3.0:1787365243.394089:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003491840 00000100:00100000:3.0:1787365243.394149:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:3.0:1787365243.394159:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2360:x1874188003491840:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1787365243.394177:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365243.394280:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47394 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989131 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787365243.394310:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365243.394355:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=360s v=(0 0) 00010000:00010000:3.0:1787365243.394361:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365243.394371:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47394 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989131 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.394392:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47394 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989131 expref: 8 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.394407:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44800, rc 0) 00000100:00100000:3.0:1787365243.394458:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb3100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2360:x1874188003491840:12345-192.168.203.13@tcp:101:bash.0 Request processed in 300us (513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365243.394465:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:2.0:1787365243.399467:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365243.399544:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003491968 00000100:00100000:3.0:1787365243.399553:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003491968 00000100:00100000:3.0:1787365243.399611:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:3.0:1787365243.399621:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:10500:x1874188003491968:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1787365243.400035:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365243.400054:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000a95c8d1f/0x872d29295eb4739b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989138 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.400086:0:6680:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47394 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989131 expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.400095:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365243.400172:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365243.400179:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a95c8d1f/0x872d29295eb4739b lrc: 4/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989138 expref: 9 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.400225:0:6680:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47394 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989131 expref: 9 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.400240:0:6680:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47394 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989131 expref: 9 pid: 6682 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365243.400253:0:6680:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6be6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1874188024482688:192.168.203.13@tcp:104: 00000100:00100000:3.0:1787365243.400379:0:6680:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b64c6e40 going to sleep for 11 seconds 00000100:00100000:1.0:1787365243.405288:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365243.405395:0:6680:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6be6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_000:lustre-OST0000_UUID:6680:1874188024482688:192.168.203.13@tcp:104: 00010000:00010000:3.0:1787365243.405428:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000a95c8d1f/0x872d29295eb4739b lrc: 3/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989138 expref: 9 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.405450:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44200, rc 0) 00000100:00100000:2.0:1787365243.405612:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003492096 00000100:00100000:2.0:1787365243.405619:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003492096 00010000:00010000:2.0:1787365243.405677:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47394 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989131 expref: 10 pid: 6682 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365243.405718:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:2.0:1787365243.405728:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e18c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+10:2362:x1874188003492096:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787365243.405741:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365243.405776:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47394 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989131 expref: 10 pid: 6682 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365243.405789:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47394 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989131 expref: 10 pid: 6682 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365243.405812:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47394 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989131 expref: 10 pid: 6682 timeout: 460 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365243.405838:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365243.405842:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365243.405850:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000a95c8d1f/0x872d29295eb4739b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989138 expref: 9 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365243.405979:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf91c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:10500:x1874188003491968:12345-192.168.203.13@tcp:101:bash.0 Request processed in 6358us (6519us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365243.405988:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00010000:00010000:2.0:1787365243.406043:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000a95c8d1f/0x872d29295eb4739b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989138 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365243.406078:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 00000000a95c8d1f/0x872d29295eb4739b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989138 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365243.406091:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1874188024482816:192.168.203.13@tcp:105: 00000100:00100000:2.0:1787365243.406155:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2797aec000 going to sleep for 11 seconds 00000100:00100000:2.0:1787365243.410667:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc7100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1874188024482816:192.168.203.13@tcp:105: 00010000:00010000:2.0:1787365243.410693:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365243.410747:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e18c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2362:x1874188003492096:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 5021us (5469us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365243.410771:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:0.0:1787365243.413017:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365243.413169:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003492352 00000100:00100000:3.0:1787365243.413179:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003492352 00000100:00100000:3.0:1787365243.413248:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:3.0:1787365243.413257:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+33:10500:x1874188003492352:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:3.0:1787365243.413660:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+34:10500:x1874188003492352:12345-192.168.203.13@tcp:35:bash.0 Request processed in 403us (663us total) trans 4294967377 rc 0/0 00000100:00100000:3.0:1787365243.413669:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:1.0:1787365243.669993:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365243.670119:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003492480 00000100:00100000:3.0:1787365243.670127:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003492480 00000100:00100000:3.0:1787365243.670187:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:3.0:1787365243.670207:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+34:10516:x1874188003492480:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1787365243.670230:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365243.670250:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb473a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898913f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.670312:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb473a9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.670328:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb473a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.670353:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb473a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365243.670408:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787365243.670425:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787365243.670452:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb473a9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.670478:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb473a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898913f expref: 36 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.670499:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb473a9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898913f expref: 35 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.670508:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:3.0:1787365243.670511:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787365243.670515:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44400, rc 0) 00000100:00100000:3.0:1787365243.670573:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+35:10516:x1874188003492480:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 377us (590us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365243.670581:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:2.0:1787365243.675477:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365243.675611:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003492736 00000100:00100000:1.0:1787365243.675620:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003492736 00000100:00100000:1.0:1787365243.675695:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:1.0:1787365243.675705:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+35:10516:x1874188003492736:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1787365243.675725:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365243.675773:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb473b0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989146 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.675874:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb473b7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.675889:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb473b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.675900:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb473b7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787365243.675920:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:1.0:1787365243.676039:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb473b0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989146 expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.676056:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb473b7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989146 expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.676064:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f2789e48d00) 00010000:00010000:1.0:1787365243.676067:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787365243.676070:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115c00, rc 0) 00000100:00100000:1.0:1787365243.676129:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+37:10516:x1874188003492736:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 424us (660us total) trans 4294967378 rc 0/0 00000100:00100000:1.0:1787365243.676136:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:0.0:1787365243.679320:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365243.679888:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003492864 00000100:00100000:1.0:1787365243.679901:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003492864 00000100:00100000:1.0:1787365243.680053:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1787365243.680063:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb843800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+37:2359:x1874188003492864:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365243.680096:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365243.680122:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb473b7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989146 expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.680140:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f2789e48d00) 00010000:00010000:1.0:1787365243.680145:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365243.680225:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb843800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+36:2359:x1874188003492864:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 163us (919us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365243.680232:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:2.0:1787365243.683152:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365243.684516:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003493120 00000100:00100000:0.0:1787365243.684531:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003493120 00000100:00100000:0.0:1787365243.684604:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:0.0:1787365243.684614:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+36:10516:x1874188003493120:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1787365243.684684:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365243.684707:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb473c5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898914d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.684821:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb473cc lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.684836:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb473cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.684846:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb473cc lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365243.684872:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787365243.685204:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb473c5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898914d expref: 39 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.685226:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb473cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898914d expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.685235:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f2789e48d00) 00010000:00010000:0.0:1787365243.685237:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787365243.685241:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780030800, rc 0) 00000100:00100000:0.0:1787365243.685378:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+38:10516:x1874188003493120:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 765us (2241us total) trans 4294967379 rc 0/0 00000100:00100000:0.0:1787365243.685386:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:0.0:1787365243.701100:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365243.701194:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003493248 00000100:00100000:3.0:1787365243.701213:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003493248 00000100:00100000:3.0:1787365243.701268:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:3.0:1787365243.701277:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2362:x1874188003493248:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:3.0:1787365243.701319:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb473da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.701340:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000a95c8d1f/0x872d29295eb4739b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989138 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.701350:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365243.701354:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787365243.701371:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb473da lrc: 4/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.701404:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000a95c8d1f/0x872d29295eb4739b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989138 expref: 8 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.701419:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000a95c8d1f/0x872d29295eb4739b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989138 expref: 8 pid: 6680 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365243.701435:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6be6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1874188024482944:192.168.203.13@tcp:104: 00000100:00100000:3.0:1787365243.701511:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b64c6240 going to sleep for 11 seconds 00000100:00100000:3.0:1787365243.715764:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6be6a00 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1874188024482944:192.168.203.13@tcp:104: 00010000:00010000:3.0:1787365243.715796:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb473da lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365243.716371:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365243.716440:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003493376 00000100:00100000:1.0:1787365243.716447:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003493376 00002000:00100000:1.0:1787365243.716489:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9f27bb842300 x1874188003493376/t0(0) o4->8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp:149/0 lens 504/0 e 0 to 0 dl 1787365254 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787365243.716498:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f27bb842300 with x1874188003493376 ext(0->8) 00010000:00010000:1.0:1787365243.716504:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a95c8d1f/0x872d29295eb4739b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989138 expref: 9 pid: 6680 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.716517:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a95c8d1f/0x872d29295eb4739b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989138 expref: 9 pid: 6680 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787365243.716524:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9f27bb842300 00000100:00100000:1.0:1787365243.716555:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:1.0:1787365243.716564:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:2361:x1874188003493376:12345-192.168.203.13@tcp:4:lfs.0 00000100:00100000:1.0:1787365243.717081:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb842300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+11:2361:x1874188003493376:12345-192.168.203.13@tcp:4:lfs.0 Request processed in 515us (709us total) trans 4294967302 rc 0/0 00000100:00100000:1.0:1787365243.717099:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00002000:00100000:1.0:1787365243.717107:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x3:0x0] (0->8) req@ffff9f27bb842300 x1874188003493376/t4294967302(0) o4->8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp:149/0 lens 504/448 e 0 to 0 dl 1787365254 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787365243.717115:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f27bb842300 with x1874188003493376 ext(0->8) 00010000:00010000:1.0:1787365243.717121:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 00000000a95c8d1f/0x872d29295eb4739b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989138 expref: 11 pid: 6680 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365243.717134:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 00000000a95c8d1f/0x872d29295eb4739b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989138 expref: 11 pid: 6680 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787365243.717141:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9f27bb842300 00000100:00100000:2.0:1787365243.733470:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365243.736366:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003493504 00000100:00100000:3.0:1787365243.736380:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003493504 00010000:00010000:3.0:1787365243.736425:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000a95c8d1f/0x872d29295eb4739b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989138 expref: 11 pid: 6680 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365243.736473:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:3.0:1787365243.736482:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+11:2362:x1874188003493504:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365243.736497:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:3.0:1787365243.736515:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:3.0:1787365243.736518:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb mtime from disk: 0 -> 1787365242 00002000:00010000:3.0:1787365243.736521:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb atime from disk: 0 -> 1787365243 00002000:00010000:3.0:1787365243.736535:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x3:0x0] updating lvb ctime from disk: 0 -> 1787365242 00010000:00010000:3.0:1787365243.736542:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000a95c8d1f/0x872d29295eb4739b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989138 expref: 11 pid: 6680 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.736557:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000a95c8d1f/0x872d29295eb4739b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989138 expref: 11 pid: 6680 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.736579:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000a95c8d1f/0x872d29295eb4739b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989138 expref: 11 pid: 6680 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.736595:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787365243.736600:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787365243.736606:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb473da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.736616:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb473da lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.736690:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365243.736762:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf92300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+10:2362:x1874188003493504:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 280us (3300us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365243.736770:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00010000:00010000:2.0:1787365243.736955:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb473da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365243.736980:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb473da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365243.737006:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb473da lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365243.737014:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb473da lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365243.737022:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb473da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365243.737028:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45a00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:2.0:1787365243.737032:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb473da lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365243.737040:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb473da lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365243.737053:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb473da lrc: 2/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365243.737062:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb473da lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365243.737132:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:2362:x1874188003493248:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 35855us (36040us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365243.737140:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:2.0:1787365243.745265:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365243.745340:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003493760 00000100:00100000:0.0:1787365243.745350:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003493760 00000100:00100000:0.0:1787365243.745405:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:0.0:1787365243.745415:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278ac6d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+38:10516:x1874188003493760:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:0.0:1787365243.745477:0:5837:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0x7:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb473cc lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898914d expref: 38 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787365243.745745:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967380 00000001:00080000:0.0:1787365243.745792:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967381 00000001:00080000:0.0:1787365243.746102:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967382 00010000:00010000:0.0:1787365243.746154:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb473e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.746183:0:5837:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47386 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898912a expref: 42 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.746193:0:5837:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb473e1 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.746235:0:5837:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47386 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898912a expref: 42 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.746250:0:5837:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47386 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898912a expref: 42 pid: 6704 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365243.746265:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb843b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1874188024483072:192.168.203.13@tcp:104: 00000100:00100000:0.0:1787365243.746339:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bcf84540 going to sleep for 11 seconds 00000100:00100000:0.0:1787365243.748969:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb843b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000_UUID:5837:1874188024483072:192.168.203.13@tcp:104: 00010000:00010000:0.0:1787365243.748996:0:5837:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb473e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365243.753550:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365243.753666:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003493888 00000100:00100000:3.0:1787365243.753675:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003493888 00010000:00010000:3.0:1787365243.753713:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47386 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898912a expref: 43 pid: 6704 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365243.753810:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:3.0:1787365243.753843:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+43:2361:x1874188003493888:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365243.753859:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365243.753865:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47386 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898912a expref: 43 pid: 6704 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.753880:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47386 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898912a expref: 43 pid: 6704 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.753902:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47386 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898912a expref: 43 pid: 6704 timeout: 460 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.753926:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f2789e48d00) 00010000:00010000:3.0:1787365243.753932:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb473e1 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.753942:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb473e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.753950:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb473e1 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.753970:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365243.754059:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+42:2361:x1874188003493888:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 218us (517us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365243.754068:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00010000:00010000:0.0:1787365243.754127:0:5837:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb473e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.754136:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb473e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787365243.754260:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967383 00000001:00080000:0.0:1787365243.754441:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967384 00000100:00100000:0.0:1787365243.754556:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb843b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874188024483200:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787365243.754608:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365243.754666:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278fd56900 going to sleep for 11 seconds 00000100:00100000:0.0:1787365243.758158:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024483200 00000100:00100000:0.0:1787365243.758174:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024483200 00000100:00100000:0.0:1787365243.758262:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787365243.758272:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5837:x1874188024483200:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787365243.758393:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb841500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5837:x1874188024483200:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 123us (3785us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365243.758400:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00080000:0.0:1787365243.758422:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787365243.758457:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb843b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874188024483200:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787365243.759216:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967385 00000100:00100000:0.0:1787365243.759302:0:5837:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb843b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874188024483328:0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787365243.759349:0:5837:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365243.759376:0:5837:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bcf84540 going to sleep for 11 seconds 00000100:00100000:0.0:1787365243.759395:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024483328 00000100:00100000:0.0:1787365243.759400:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024483328 00000100:00100000:0.0:1787365243.759426:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787365243.759432:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5837:x1874188024483328:12345-0@lo:1000:mdt_rdpg00_001.0 00000100:00100000:0.0:1787365243.759584:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb842d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+8:5837:x1874188024483328:12345-0@lo:1000:mdt_rdpg00_001.0 Request processed in 152us (234us total) trans 4294967303 rc 0/0 00000100:00100000:0.0:1787365243.759592:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787365243.759643:0:5837:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb843b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_001:lustre-MDT0000-mdtlov_UUID:5837:1874188024483328:0@lo:1000:mdt_rdpg00_001.0 00000001:00080000:0.0:1787365243.759689:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967386 00010000:00010000:0.0:1787365243.759723:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb473e1 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.759744:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb473e1 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.762076:0:5837:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb473e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.762084:0:5837:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780031c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365243.762090:0:5837:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb473e1 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.762098:0:5837:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb473e1 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.762116:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f2789e48d00) 00010000:00010000:0.0:1787365243.762120:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787365243.762124:0:5837:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb473e1 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.762131:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb473e1 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787365243.762385:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x8:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787365243.762482:0:5837:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].3, 64 off8384 00000004:00080000:0.0:1787365243.762495:0:5837:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 360926868426ns, next at 361926865025ns, rc = 0 00000001:00080000:0.0:1787365243.762503:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967387 00010000:00010000:0.0:1787365243.762552:0:5837:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f2789e48d00) 00010000:00010000:0.0:1787365243.762555:0:5837:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787365243.762564:0:5837:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb473cc lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898914d expref: 46 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365243.762701:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278ac6d850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+45:10516:x1874188003493760:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 17287us (17443us total) trans 4294967388 rc 0/0 00000100:00100000:0.0:1787365243.762711:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000020:00080000:0.0:1787365243.762716:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:0.0:1787365243.779157:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024483456:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787365243.779243:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365243.779491:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024483456 00000100:00100000:2.0:1787365243.779499:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024483456 00000100:00100000:2.0:1787365243.779552:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:2.0:1787365243.779562:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3310:x1874188024483456:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787365243.779584:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 3407872 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365243.780946:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb842680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+8:3310:x1874188024483456:12345-0@lo:13:osp-pre-0-0.0 Request processed in 1378us (1695us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365243.780957:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:0.0:1787365243.781184:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024483456:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787365243.782596:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365243.784110:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003494016 00000100:00100000:0.0:1787365243.784121:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003494016 00000100:00100000:0.0:1787365243.784190:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:0.0:1787365243.784211:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+45:10516:x1874188003494016:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1787365243.784235:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365243.784260:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb473e8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989154 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.784321:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb473e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989154 expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.784335:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb473e8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989154 expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365243.784352:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:0.0:1787365243.784355:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787365243.784358:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780030800, rc 0) 00000100:00100000:0.0:1787365243.784409:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be6680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+46:10516:x1874188003494016:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 211us (1820us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365243.784429:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:2.0:1787365243.796360:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365243.801809:0:11946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003494272 00000100:00100000:0.0:1787365243.801824:0:11946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003494272 00000100:00100000:0.0:1787365243.801897:0:11946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:0.0:1787365243.801907:0:11946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+46:10516:x1874188003494272:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1787365243.802516:0:11946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+47:10516:x1874188003494272:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 608us (6162us total) trans 4294967389 rc 0/0 00000100:00100000:2.0:1787365243.802525:0:11946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:2.0:1787365243.940210:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365243.940520:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003494400 00000100:00100000:3.0:1787365243.940530:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003494400 00000100:00100000:3.0:1787365243.940589:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:3.0:1787365243.940615:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+47:10526:x1874188003494400:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:3.0:1787365243.941459:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb473ef lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.941477:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb473ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.941490:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb473ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.941505:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb473f6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.941512:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb473f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.941519:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb473f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.941615:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb473fd lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.941623:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb473fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.941664:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb473fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787365243.942799:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb473fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.942819:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb473ef lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.943047:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb473ef lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.943053:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb473ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.943059:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365243.943063:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb473ef lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.943070:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb473ef lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.943084:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:3.0:1787365243.943087:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365243.943091:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb473ef lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.943097:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb473ef lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.943116:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb473f6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.943120:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb473f6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.943125:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb473f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.943129:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365243.943139:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb473f6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.943144:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb473f6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.943152:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f2789e48300) 00010000:00010000:3.0:1787365243.943154:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365243.943158:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb473f6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.943164:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb473f6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.943181:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb473fd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.943187:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb473fd lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.943192:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb473fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.943206:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365243.943209:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb473fd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.943215:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb473fd lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.943222:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:3.0:1787365243.943224:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365243.943233:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb473fd lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365243.943239:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb473fd lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365243.943402:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf93b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+47:10526:x1874188003494400:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 2784us (3207us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365243.943413:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:3.0:1787365244.034090:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365244.034279:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003494656 00000100:00100000:0.0:1787365244.034289:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003494656 00000100:00100000:0.0:1787365244.034420:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 102 00000100:00100000:0.0:1787365244.034430:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+47:10529:x1874188003494656:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1787365244.034450:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365244.034470:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb47404 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898915b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.034543:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4740b lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.034558:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4740b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.034569:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4740b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.034584:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47412 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.034591:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.034599:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.034897:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47419 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.034907:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.035021:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47419 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365244.035032:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:0.0:1787365244.035121:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4740b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.035129:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4740b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.035135:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4740b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.035141:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780031a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365244.035145:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4740b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.035152:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4740b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.035165:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:0.0:1787365244.035168:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365244.035172:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4740b lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.035188:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4740b lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.035216:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47412 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.035222:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47412 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.035229:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47412 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.035234:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365244.035237:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47412 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.035242:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47412 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.035250:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f278a0ad500) 00010000:00010000:0.0:1787365244.035252:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365244.035255:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47412 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.035259:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47412 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.035297:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb47404 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898915b expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.035309:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47419 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898915b expref: 49 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.035322:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:0.0:1787365244.035325:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787365244.035327:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27c2045a00, rc 0) 00000100:00100000:0.0:1787365244.035441:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+49:10529:x1874188003494656:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1011us (1362us total) trans 4294967390 rc 0/0 00000100:00100000:0.0:1787365244.035449:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 102 00000100:00080000:2.0:1787365244.035527:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365244.039733:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365244.039873:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003494784 00000100:00100000:0.0:1787365244.039882:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003494784 00000100:00100000:0.0:1787365244.039948:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:0.0:1787365244.039958:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+49:10529:x1874188003494784:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:0.0:1787365244.040026:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47427 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.040044:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.040056:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.040081:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47427 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.040087:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47427 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.040093:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.040099:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2044400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365244.040116:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47427 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.040124:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47427 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.040136:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:0.0:1787365244.040139:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787365244.040144:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47427 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.040150:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47427 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365244.040234:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+49:10529:x1874188003494784:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 277us (509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365244.040241:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 103 00000100:00100000:3.0:1787365244.042911:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365244.043108:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003495040 00000100:00100000:0.0:1787365244.043116:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003495040 00000100:00100000:0.0:1787365244.043167:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:0.0:1787365244.043176:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+49:10529:x1874188003495040:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1787365244.043409:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+50:10529:x1874188003495040:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 232us (506us total) trans 4294967391 rc 0/0 00000100:00100000:0.0:1787365244.043416:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:2.0:1787365244.151180:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365244.151274:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003495296 00000100:00100000:3.0:1787365244.151284:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003495296 00000100:00100000:3.0:1787365244.151353:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 104 00000100:00100000:3.0:1787365244.151364:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+50:10539:x1874188003495296:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1787365244.151388:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365244.151391:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787365244.151419:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb473a9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898913f expref: 50 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365244.151441:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:3.0:1787365244.151446:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787365244.151460:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb4742e lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989162 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365244.151555:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47435 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365244.151569:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365244.151595:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47435 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365244.151607:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 9 00010000:00010000:3.0:1787365244.151777:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb4742e lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989162 expref: 52 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365244.151793:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47435 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989162 expref: 51 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365244.151799:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:3.0:1787365244.151802:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787365244.151805:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44200, rc 0) 00000100:00100000:3.0:1787365244.151875:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+51:10539:x1874188003495296:12345-192.168.203.13@tcp:101:bash.0 Request processed in 514us (705us total) trans 4294967392 rc 0/0 00000100:00100000:3.0:1787365244.151882:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 104 00000100:00100000:2.0:1787365244.158727:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365244.158816:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003495552 00000100:00100000:0.0:1787365244.158836:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003495552 00000100:00100000:0.0:1787365244.158891:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 105 00000100:00100000:0.0:1787365244.158901:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+51:10539:x1874188003495552:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:0.0:1787365244.158970:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:0.0:1787365244.159013:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47435 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989162 expref: 51 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.159039:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47419 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898915b expref: 50 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.159050:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:0.0:1787365244.159055:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787365244.159268:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47443 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.159282:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47443 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.159291:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47443 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787365244.159343:0:5835:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967393 00000004:00010000:0.0:1787365244.159369:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e4bdfa88 reply state 00000000d766013d transno 4294967394 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47443 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365244.159378:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787365244.159574:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+52:10539:x1874188003495552:12345-192.168.203.13@tcp:36:bash.0 Request processed in 673us (855us total) trans 4294967394 rc 0/0 00000100:00100000:0.0:1787365244.159581:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 105 00000020:00080000:0.0:1787365244.159585:0:5835:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:2.0:1787365244.164321:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365244.165072:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003495680 00000100:00100000:3.0:1787365244.165084:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003495680 00000100:00100000:3.0:1787365244.165145:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 106 00000100:00100000:3.0:1787365244.165156:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+52:10539:x1874188003495680:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1787365244.165178:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365244.167737:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47443 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.167754:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47443 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.167762:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47443 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.167769:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2044400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365244.167773:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47443 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.167780:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47443 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.167795:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:1.0:1787365244.168174:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365244.168180:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47443 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.168187:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb47443 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365244.170155:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb4744a lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989169 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365244.170294:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47451 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365244.170319:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365244.170336:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365244.170367:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:3.0:1787365244.170371:0:6704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787365244.170389:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47451 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365244.170418:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb4744a lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989169 expref: 53 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365244.170438:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47451 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989169 expref: 52 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365244.170447:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:3.0:1787365244.170449:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787365244.170453:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44400, rc 0) 00000100:00100000:3.0:1787365244.170742:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+52:10539:x1874188003495680:12345-192.168.203.13@tcp:101:bash.0 Request processed in 5376us (6217us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365244.170755:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 106 00000100:00100000:2.0:1787365244.174343:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365244.176207:0:11946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003495936 00000100:00100000:1.0:1787365244.176221:0:11946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003495936 00000100:00100000:1.0:1787365244.176293:0:11946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:1.0:1787365244.176305:0:11946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+52:10539:x1874188003495936:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:1.0:1787365244.176670:0:11946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+53:10539:x1874188003495936:12345-192.168.203.13@tcp:35:bash.0 Request processed in 367us (2335us total) trans 4294967395 rc 0/0 00000100:00100000:1.0:1787365244.176679:0:11946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00010000:00010000:0.0:1787365244.276510:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365244.294027:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365244.294961:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003496064 00000100:00100000:3.0:1787365244.294972:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003496064 00000100:00100000:3.0:1787365244.295025:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 107 00000100:00100000:3.0:1787365244.295035:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+53:10545:x1874188003496064:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1787365244.295059:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365244.295086:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb47458 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989170 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365244.295149:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb4745f lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365244.295164:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb4745f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365244.295176:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb4745f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365244.295437:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x3:0x0]: returning size 7680 00000004:00200000:3.0:1787365244.295441:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:3.0:1787365244.295465:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb4745f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365244.295491:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb47458 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989170 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365244.295513:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb4745f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989170 expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365244.295521:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:3.0:1787365244.295523:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787365244.295527:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45200, rc 0) 00000100:00100000:3.0:1787365244.295595:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8e680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+54:10545:x1874188003496064:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 561us (1575us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365244.295602:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 107 00000100:00100000:0.0:1787365244.301786:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365244.301994:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003496192 00000100:00100000:1.0:1787365244.302004:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003496192 00000100:00100000:1.0:1787365244.302052:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:1.0:1787365244.302062:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+54:10545:x1874188003496192:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1787365244.302081:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365244.302102:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb47466 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989177 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302161:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb4746d lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302176:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb4746d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302251:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb4746d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302276:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114000/0x872d29295eb47474 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302283:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114000/0x872d29295eb47474 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302290:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114000/0x872d29295eb47474 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302393:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb4747b lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302402:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb4747b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302409:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb4747b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787365244.302443:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787365244.302447:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787365244.302463:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb4747b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302474:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb4747b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302482:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb4746d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302489:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb4746d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302506:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb4746d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302513:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798115e00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365244.302517:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb4746d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302524:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb4746d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302535:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:1.0:1787365244.302538:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365244.302543:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb4746d lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302549:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb4746d lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302561:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114000/0x872d29295eb47474 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302567:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114000/0x872d29295eb47474 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302573:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114000/0x872d29295eb47474 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302578:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365244.302581:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114000/0x872d29295eb47474 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302596:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114000/0x872d29295eb47474 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302604:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f2784761000) 00010000:00010000:1.0:1787365244.302606:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365244.302609:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114000/0x872d29295eb47474 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302615:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114000/0x872d29295eb47474 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302668:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb47466 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989177 expref: 56 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302681:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb4747b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989177 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.302688:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:1.0:1787365244.302690:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787365244.302692:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115600, rc 0) 00000100:00100000:1.0:1787365244.302754:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb841c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+55:10545:x1874188003496192:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 693us (977us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365244.302762:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:3.0:1787365244.310766:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365244.310810:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365244.311135:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003496576 00000100:00100000:3.0:1787365244.311144:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003496576 00000100:00100000:3.0:1787365244.311452:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1787365244.311464:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+55:2361:x1874188003496576:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365244.311480:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365244.311505:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb4747b lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989177 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365244.311524:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:3.0:1787365244.311528:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365244.311581:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+54:2361:x1874188003496576:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 119us (770us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365244.311589:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:0.0:1787365244.311713:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003496448 00000100:00100000:0.0:1787365244.311718:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003496448 00000100:00100000:0.0:1787365244.311750:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 109 00000100:00100000:0.0:1787365244.311767:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+54:10545:x1874188003496448:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1787365244.311784:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365244.311799:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47482 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898917e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.311908:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47489 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.312048:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47451 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989169 expref: 55 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.312058:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47489 lrc: 4/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.312090:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47451 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989169 expref: 55 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.312104:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47451 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989169 expref: 55 pid: 6704 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365244.312118:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb840380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874188024483584:192.168.203.13@tcp:104: 00000100:00100000:0.0:1787365244.312175:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abfcf300 going to sleep for 11 seconds 00000100:00100000:0.0:1787365244.319001:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365244.319049:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb840380 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874188024483584:192.168.203.13@tcp:104: 00010000:00010000:0.0:1787365244.319074:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47489 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365244.320652:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003496704 00000100:00100000:1.0:1787365244.320663:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003496704 00010000:00010000:1.0:1787365244.320701:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47451 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989169 expref: 56 pid: 6704 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365244.320752:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:1.0:1787365244.320762:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb843100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+56:2362:x1874188003496704:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365244.320776:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365244.320784:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47451 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989169 expref: 56 pid: 6704 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.320797:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47451 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989169 expref: 56 pid: 6704 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.320819:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47451 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989169 expref: 56 pid: 6704 timeout: 461 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.320857:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:1.0:1787365244.320863:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47489 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.320872:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47489 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.320880:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47489 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.320903:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365244.320967:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb843100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+55:2362:x1874188003496704:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 206us (1975us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365244.320975:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00010000:00010000:1.0:1787365244.320999:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47489 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.321013:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47489 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787365244.321031:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:1.0:1787365244.321166:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47482 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898917e expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.321182:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47489 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898917e expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365244.321205:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:1.0:1787365244.321207:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787365244.321210:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27c2045800, rc 0) 00000100:00100000:1.0:1787365244.321236:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+55:10545:x1874188003496448:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 9471us (10478us total) trans 4294967396 rc 0/0 00000100:00100000:1.0:1787365244.321243:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 109 00000100:00100000:3.0:1787365244.325004:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365244.325039:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003496960 00000100:00100000:3.0:1787365244.325048:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003496960 00000100:00100000:3.0:1787365244.325104:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:3.0:1787365244.325113:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+55:10545:x1874188003496960:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:3.0:1787365244.325127:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365244.325152:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb473e8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989154 expref: 55 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365244.325173:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:3.0:1787365244.325178:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365244.325249:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be6d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+54:10545:x1874188003496960:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 136us (255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365244.325275:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:0.0:1787365244.334717:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365244.334764:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003497088 00000100:00100000:0.0:1787365244.334773:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003497088 00000100:00100000:0.0:1787365244.334841:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 110 00000100:00100000:0.0:1787365244.334859:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+54:10545:x1874188003497088:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:0.0:1787365244.334973:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47497 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.334991:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47497 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.335002:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47497 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787365244.335178:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].2, 136 off8464 00000100:00100000:0.0:1787365244.335365:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb840380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+54:10545:x1874188003497088:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 509us (657us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365244.335372:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 110 00000100:00100000:1.0:1787365244.340845:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365244.341297:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003497216 00000100:00100000:0.0:1787365244.341306:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003497216 00000100:00100000:0.0:1787365244.341367:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 111 00000100:00100000:0.0:1787365244.341377:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+54:10545:x1874188003497216:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1787365244.341397:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365244.341419:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4749e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989185 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.341474:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47497 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.341485:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4749e lrc: 4/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989185 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.341519:0:5835:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47497 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.341533:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4749e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989185 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.341546:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:0.0:1787365244.341549:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787365244.341553:0:5835:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4749e lrc: 3/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989185 expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365244.341561:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27c2044400, rc 0) 00000100:00100000:0.0:1787365244.341614:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c5c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+55:10545:x1874188003497216:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 239us (780us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365244.341622:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 111 00000001:00080000:2.0:1787365244.362989:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967303 is committed 00000001:00080000:2.0:1787365244.363009:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967299 is committed 00000001:00080000:2.0:1787365244.363122:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967302 is committed 00000004:00080000:1.0:1787365244.788822:0:8089:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 361953194076ns, next at 362953191708ns, rc = 0 00000100:00100000:3.0:1787365244.788926:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024483712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787365244.788992:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365244.789114:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024483712 00000100:00100000:2.0:1787365244.789121:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024483712 00000100:00100000:2.0:1787365244.789187:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787365244.789209:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874188024483712:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787365244.789239:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365244.789283:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3311:x1874188024483712:12345-0@lo:13:osp-pre-1-0.0 Request processed in 77us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365244.789290:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:1.0:1787365244.789427:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874188024483968:0@lo:400:kworker.0 00000100:00100000:1.0:1787365244.789458:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365244.789478:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787365244.789483:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024483840:0@lo:400:kworker.0 00000100:00100000:1.0:1787365244.789510:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365244.789530:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024484352:0@lo:400:kworker.0 00000100:00100000:1.0:1787365244.789552:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365244.789590:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024483840 00000100:00100000:1.0:1787365244.789594:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024483840 00000100:00100000:1.0:1787365244.789619:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787365244.789646:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3313:x1874188024483840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365244.789682:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b7050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3313:x1874188024483840:12345-0@lo:400:kworker.0 Request processed in 57us (171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365244.789688:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 291 00000100:00100000:1.0:1787365244.789725:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024483840:0@lo:400:kworker.0 00000100:00080000:3.0:1787365244.789825:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787365244.789837:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024484224:0@lo:400:kworker.0 00000100:00100000:3.0:1787365244.789864:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365244.789901:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024483712:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787365244.789912:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787365244.789917:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024484096:0@lo:400:kworker.0 00000100:00100000:3.0:1787365244.789942:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365244.790083:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024484224 00000100:00100000:2.0:1787365244.790088:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024484224 00000100:00100000:2.0:1787365244.790121:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787365244.790129:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024484224:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365244.790165:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024484224:12345-0@lo:400:kworker.0 Request processed in 38us (300us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365244.790172:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787365244.790254:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024483968 00000100:00100000:0.0:1787365244.790259:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024483968 00000100:00100000:0.0:1787365244.790292:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024484352 00000100:00100000:0.0:1787365244.790295:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024484352 00000100:00100000:0.0:1787365244.790316:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024484096 00000100:00100000:0.0:1787365244.790319:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024484096 00000100:00100000:0.0:1787365244.790335:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787365244.790341:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874188024483968:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365244.790381:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874188024483968:12345-0@lo:400:kworker.0 Request processed in 40us (922us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365244.790388:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 146 00000100:00100000:0.0:1787365244.790401:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787365244.790415:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024484352:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365244.790447:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024484352:12345-0@lo:400:kworker.0 Request processed in 33us (894us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365244.790453:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 147 00000100:00100000:0.0:1787365244.790464:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 148 00000100:00100000:0.0:1787365244.790469:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024484096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365244.790489:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024484096:12345-0@lo:400:kworker.0 Request processed in 21us (547us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365244.790492:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 148 00000100:00080000:0.0:1787365244.790506:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365244.790518:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c4e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024484352:0@lo:400:kworker.0 00000100:00100000:0.0:1787365244.790524:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874188024483968:0@lo:400:kworker.0 00000100:00100000:3.0:1787365244.790655:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c5880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024484096:0@lo:400:kworker.0 00000100:00100000:3.0:1787365244.790664:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967303 gen 2 00000004:00080000:3.0:1787365244.790669:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967300 committed transno 4294967303 00000004:00080000:3.0:1787365244.790684:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f27bae85f80, transno 4294967301 00000004:00080000:3.0:1787365244.790702:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967303 committed transno 4294967303 00000100:00100000:3.0:1787365244.790713:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c5180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024484224:0@lo:400:kworker.0 00000040:00080000:0.0:1787365245.299598:0:11664:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787365245.299606:0:11664:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787365245.300235:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 3 00000040:00080000:0.0:1787365245.300243:0:11664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787365245.303906:0:11664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb843480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11664:1874188024484480:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787365245.304028:0:11664:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27c00b9540 going to sleep for 11 seconds 00010000:00010000:2.0:1787365245.306699:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365245.309932:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365245.310119:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003497344 00000100:00100000:2.0:1787365245.310127:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003497344 00000100:00100000:2.0:1787365245.310197:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 112 00000100:00100000:2.0:1787365245.310209:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+56:10547:x1874188003497344:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787365245.310242:0:6704:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787365245.310348:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+56:10547:x1874188003497344:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 142us (425us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365245.310356:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 112 00000100:00100000:0.0:1787365245.310914:0:11664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb843480 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11664:1874188024484480:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787365245.315378:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365245.316199:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003497472 00000100:00100000:2.0:1787365245.316209:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003497472 00000100:00100000:2.0:1787365245.316274:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:2.0:1787365245.316284:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+55:10547:x1874188003497472:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787365245.316363:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb474a5 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.316380:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb474a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.316391:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb474a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.316564:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb474ac lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.316573:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb474ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.316580:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb474ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.316604:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb474b3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.316613:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb474b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.316619:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb474b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365245.316682:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:2.0:1787365245.316698:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365245.316711:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb474b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.316722:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb474a5 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.316729:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb474a5 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.316735:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb474a5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.316741:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365245.316745:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb474a5 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.316753:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb474a5 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.316765:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f27988dfd00) 00010000:00010000:2.0:1787365245.316768:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365245.316772:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb474a5 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.316779:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb474a5 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.316792:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb474ac lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.316798:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb474ac lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.317002:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb474ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.317009:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365245.317012:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb474ac lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.317020:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb474ac lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.317028:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x77a79f1b (ffff9f27988df700) 00010000:00010000:2.0:1787365245.317031:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365245.317034:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb474ac lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.317039:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb474ac lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x77a79f1b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.317055:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb474b3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.317062:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb474b3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.317067:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb474b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.317072:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709e00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365245.317075:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb474b3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.317090:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb474b3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.317098:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:2.0:1787365245.317101:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365245.317104:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb474b3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.317110:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb474b3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365245.317197:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+55:10547:x1874188003497472:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 905us (1817us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365245.317206:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 113 00000100:00100000:3.0:1787365245.320149:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365245.320239:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003497728 00000100:00100000:2.0:1787365245.320248:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003497728 00000100:00100000:2.0:1787365245.320309:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:2.0:1787365245.320319:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+55:10547:x1874188003497728:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365245.320338:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365245.320355:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb474ba lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898918c expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.320454:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb474c1 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.320469:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb474c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.320480:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb474c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365245.320503:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787365245.320600:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb474c1 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.320608:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb474c1 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.320613:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb474c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.320619:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365245.320622:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb474c1 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.320652:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb474c1 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.320663:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:2.0:1787365245.320666:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787365245.320670:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb474c1 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.320676:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb474c1 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.320714:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb474ba lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898918c expref: 57 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.320725:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f27988dfd00) 00010000:00010000:2.0:1787365245.320727:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787365245.320739:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb474ba lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898918c expref: 57 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.320749:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb709000, rc 0) 00000100:00100000:2.0:1787365245.320803:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+56:10547:x1874188003497728:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 486us (663us total) trans 4294967397 rc 301/301 00000100:00100000:2.0:1787365245.320811:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:3.0:1787365245.324029:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365245.324107:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003497856 00000100:00100000:0.0:1787365245.324116:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003497856 00000100:00100000:0.0:1787365245.324168:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:0.0:1787365245.324177:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+56:10547:x1874188003497856:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787365245.324221:0:5835:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787365245.324329:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+56:10547:x1874188003497856:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 153us (310us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365245.324336:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 115 00000100:00100000:3.0:1787365245.328558:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365245.328665:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003498112 00000100:00100000:2.0:1787365245.328674:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003498112 00000100:00100000:2.0:1787365245.328726:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:2.0:1787365245.328737:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+56:10547:x1874188003498112:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365245.328759:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365245.328763:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787365245.328789:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb4745f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989170 expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.328812:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:2.0:1787365245.328817:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787365245.328829:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb474cf lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989193 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787365245.329204:0:6704:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x4:0x0], index 1: 0 00010000:00010000:2.0:1787365245.329375:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb474d6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.329388:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb474d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.329398:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb474d6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.329460:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb474cf lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989193 expref: 58 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.329476:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb474d6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989193 expref: 57 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.329484:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f27988df900) 00010000:00010000:2.0:1787365245.329486:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787365245.329489:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb708600, rc 0) 00000100:00100000:2.0:1787365245.329553:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b55500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+57:10547:x1874188003498112:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 817us (1002us total) trans 4294967398 rc 0/0 00000100:00100000:2.0:1787365245.329560:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 116 00000100:00100000:0.0:1787365245.335959:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365245.336042:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003498368 00000100:00100000:1.0:1787365245.336052:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003498368 00000100:00100000:1.0:1787365245.336137:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:1.0:1787365245.336148:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+57:10547:x1874188003498368:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:1.0:1787365245.336212:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365245.336238:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb474d6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989193 expref: 57 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.336255:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f27988df900) 00010000:00010000:1.0:1787365245.336267:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787365245.336286:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114000/0x872d29295eb474e4 lrc: 3/0,1 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.336299:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114000/0x872d29295eb474e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.336308:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114000/0x872d29295eb474e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.336322:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb474eb lrc: 3/0,1 mode: --/PW res: [0x200000401:0x3:0x0].0xf88c4308 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.336346:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb474eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf88c4308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.336354:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb474eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf88c4308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.336434:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114000/0x872d29295eb474e4 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.336442:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114000/0x872d29295eb474e4 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.336448:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114000/0x872d29295eb474e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.336453:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365245.336458:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114000/0x872d29295eb474e4 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.336465:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114000/0x872d29295eb474e4 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.336474:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:1.0:1787365245.336477:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365245.336481:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114000/0x872d29295eb474e4 lrc: 2/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.336486:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114000/0x872d29295eb474e4 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.336496:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb474eb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x3:0x0].0xf88c4308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.336509:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb474eb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf88c4308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.336514:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb474eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf88c4308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.336520:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798115e00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365245.336523:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb474eb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf88c4308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.336529:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb474eb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x3:0x0].0xf88c4308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.336537:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0xf88c4308 (ffff9f2784761000) 00010000:00010000:1.0:1787365245.336540:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365245.336542:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb474eb lrc: 2/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf88c4308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.336548:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb474eb lrc: 0/0,0 mode: --/PW res: [0x200000401:0x3:0x0].0xf88c4308 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365245.336651:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb843480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+56:10547:x1874188003498368:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 505us (756us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787365245.336659:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 117 00000100:00100000:3.0:1787365245.339065:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365245.339493:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003498496 00000100:00100000:2.0:1787365245.339503:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003498496 00000100:00100000:2.0:1787365245.339569:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:2.0:1787365245.339580:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+56:10547:x1874188003498496:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365245.339599:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365245.339622:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb474f2 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898919a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.339674:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb474f9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.339687:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb474f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.339697:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb474f9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.339798:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb474f2 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898919a expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.340130:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb474f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898919a expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.340141:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f27988df700) 00010000:00010000:2.0:1787365245.340144:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787365245.340147:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb709600, rc 0) 00000100:00100000:2.0:1787365245.340213:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b57480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+57:10547:x1874188003498496:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 635us (1155us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365245.340220:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 118 00000100:00100000:3.0:1787365245.345686:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365245.345854:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003498752 00000100:00100000:0.0:1787365245.345863:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003498752 00000100:00100000:0.0:1787365245.345933:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 119 00000100:00100000:0.0:1787365245.345943:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+57:10547:x1874188003498752:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787365245.346017:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47500 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.346034:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47500 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.346045:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47500 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787365245.346287:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].5, 88 off8560 00000004:00010000:0.0:1787365245.346378:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f616d55d reply state 000000005c701844 transno 4294967399 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47500 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365245.346387:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787365245.346482:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b54380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+59:10547:x1874188003498752:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 539us (805us total) trans 4294967399 rc 0/0 00000100:00100000:0.0:1787365245.346488:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 119 00010000:00010000:0.0:1787365245.348406:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47500 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.348575:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47500 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.348601:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47500 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.348608:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2045400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365245.348613:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47500 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.348621:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47500 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.348694:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f27988df700) 00010000:00010000:0.0:1787365245.348698:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787365245.348702:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47500 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.348708:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47500 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365245.351289:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365245.356095:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003498880 00000100:00100000:1.0:1787365245.356109:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003498880 00000100:00100000:1.0:1787365245.356234:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:1.0:1787365245.356246:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+58:10547:x1874188003498880:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787365245.356269:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365245.356304:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47507 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989891a1 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.356365:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47507 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891a1 expref: 59 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.356379:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47507 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891a1 expref: 59 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.356397:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f27988df700) 00010000:00010000:1.0:1787365245.356400:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787365245.356403:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115e00, rc 0) 00000100:00100000:1.0:1787365245.356480:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbb9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+59:10547:x1874188003498880:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 237us (5198us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365245.356488:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 120 00000100:00100000:3.0:1787365245.361098:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365245.361245:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003499008 00000100:00100000:2.0:1787365245.361256:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003499008 00000100:00100000:2.0:1787365245.361328:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:2.0:1787365245.361338:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2361:x1874188003499008:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787365245.361650:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b37480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:2361:x1874188003499008:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 312us (560us total) trans 4294967307 rc 0/0 00000100:00100000:2.0:1787365245.361659:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00080000:3.0:1787365245.362246:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787365245.366866:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365245.366970:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003499264 00000100:00100000:2.0:1787365245.366978:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003499264 00000100:00100000:2.0:1787365245.367028:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:2.0:1787365245.367036:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+59:10547:x1874188003499264:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:2.0:1787365245.367261:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+60:10547:x1874188003499264:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 225us (403us total) trans 4294967400 rc 0/0 00000100:00100000:2.0:1787365245.367283:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:3.0:1787365245.371291:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365245.375039:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003499520 00000100:00100000:0.0:1787365245.375052:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003499520 00000100:00100000:0.0:1787365245.375128:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:0.0:1787365245.375138:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+60:10547:x1874188003499520:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787365245.375269:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b36680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+60:10547:x1874188003499520:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 132us (3987us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365245.375277:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:3.0:1787365245.377846:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365245.378180:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003499648 00000100:00100000:0.0:1787365245.378199:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003499648 00000100:00100000:0.0:1787365245.378259:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:0.0:1787365245.378269:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+60:10547:x1874188003499648:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787365245.378300:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365245.378321:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb4750e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989891a8 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.378386:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47515 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.378401:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.378412:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365245.378443:0:6704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787365245.378460:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47515 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.378484:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb4750e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891a8 expref: 62 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.378502:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47515 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891a8 expref: 61 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.378511:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f27988df700) 00010000:00010000:0.0:1787365245.378514:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787365245.378517:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780030800, rc 0) 00000100:00100000:0.0:1787365245.378575:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b36300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+61:10547:x1874188003499648:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 307us (739us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365245.378583:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 122 00000100:00100000:3.0:1787365245.382484:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365245.385043:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003499776 00000100:00100000:2.0:1787365245.385057:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003499776 00000100:00100000:2.0:1787365245.385125:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:2.0:1787365245.385136:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279809bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:2359:x1874188003499776:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365245.385154:0:10260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365245.385178:0:10260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb4751c lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989891af expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787365245.385215:0:10260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a89077c, blocks: 0x1 00010000:00010000:2.0:1787365245.385236:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=362s v=(0 0) 00010000:00010000:2.0:1787365245.385240:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365245.385249:0:10260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb4751c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891af expref: 10 pid: 10260 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.385266:0:10260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb4751c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891af expref: 10 pid: 10260 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.385279:0:10260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb709000, rc 0) 00000100:00100000:2.0:1787365245.385339:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279809bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+10:2359:x1874188003499776:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 205us (2864us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365245.385347:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:3.0:1787365245.392248:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365245.392329:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003500032 00000100:00100000:0.0:1787365245.392337:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003500032 00000100:00100000:0.0:1787365245.392391:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:0.0:1787365245.392401:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279809b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+61:10547:x1874188003500032:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787365245.392505:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279809b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+61:10547:x1874188003500032:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 105us (265us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365245.392513:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:0.0:1787365245.397124:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365245.397903:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003500160 00000100:00100000:2.0:1787365245.397913:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003500160 00000100:00100000:2.0:1787365245.397981:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:2.0:1787365245.398010:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+10:10547:x1874188003500160:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365245.398028:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365245.398046:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044c7ae50/0x872d29295eb47523 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989891b6 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.398082:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb4751c lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891af expref: 11 pid: 10260 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.398092:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365245.398096:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365245.398101:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044c7ae50/0x872d29295eb47523 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891b6 expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.398133:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb4751c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891af expref: 11 pid: 10260 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.398146:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb4751c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891af expref: 11 pid: 10260 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365245.398159:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2788f8d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1874188024484608:192.168.203.13@tcp:104: 00000100:00100000:2.0:1787365245.398431:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bcf84a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787365245.403464:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2788f8d500 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1874188024484608:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365245.403512:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000044c7ae50/0x872d29295eb47523 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891b6 expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.403553:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb709a00, rc 0) 00000100:00100000:2.0:1787365245.403698:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb841880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+11:10547:x1874188003500160:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 5690us (6582us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365245.403708:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:0.0:1787365245.414224:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365245.414365:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003500288 00000100:00100000:2.0:1787365245.414375:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003500288 00010000:00010000:2.0:1787365245.414414:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb4751c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891af expref: 11 pid: 10260 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365245.414444:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:2.0:1787365245.414454:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27882b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+11:2361:x1874188003500288:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787365245.414469:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365245.414492:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb4751c lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891af expref: 11 pid: 10260 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.414506:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb4751c lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891af expref: 11 pid: 10260 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.414528:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb4751c lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891af expref: 11 pid: 10260 timeout: 462 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.414545:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365245.414549:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365245.414557:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000044c7ae50/0x872d29295eb47523 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891b6 expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.414581:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044c7ae50/0x872d29295eb47523 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891b6 expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.414615:0:8435:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000044c7ae50/0x872d29295eb47523 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891b6 expref: 10 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365245.414667:0:8435:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2788f8d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8435:1874188024484736:192.168.203.13@tcp:105: 00000100:00100000:2.0:1787365245.414742:0:8435:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bcf84a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787365245.425981:0:8435:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2788f8d500 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_004:lustre-OST0001_UUID:8435:1874188024484736:192.168.203.13@tcp:105: 00010000:00010000:2.0:1787365245.426008:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365245.426061:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27882b8850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+10:2361:x1874188003500288:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 11608us (11846us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365245.426072:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:2.0:1787365245.428867:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365245.429136:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003500416 00000100:00100000:1.0:1787365245.429145:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003500416 00002000:00100000:1.0:1787365245.429201:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9f2788f8d500 x1874188003500416/t0(0) o4->8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp:151/0 lens 504/0 e 0 to 0 dl 1787365256 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787365245.429212:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2788f8d500 with x1874188003500416 ext(0->12) 00002000:00010000:1.0:1787365245.429218:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2788f8d500 00000100:00100000:1.0:1787365245.429305:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:1.0:1787365245.429315:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+10:2361:x1874188003500416:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787365245.429803:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+12:2361:x1874188003500416:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 489us (943us total) trans 4294967308 rc 0/0 00000100:00100000:1.0:1787365245.429822:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00002000:00100000:1.0:1787365245.429836:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x4:0x0] (0->12) req@ffff9f2788f8d500 x1874188003500416/t4294967308(0) o4->8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp:151/0 lens 504/448 e 0 to 0 dl 1787365256 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787365245.429844:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f2788f8d500 with x1874188003500416 ext(0->12) 00002000:00010000:1.0:1787365245.429848:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f2788f8d500 00000100:00100000:0.0:1787365245.438941:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365245.439103:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003500544 00000100:00100000:2.0:1787365245.439112:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003500544 00000100:00100000:2.0:1787365245.439170:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 124 00000100:00100000:2.0:1787365245.439180:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+61:10547:x1874188003500544:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000001:00080000:3.0:1787365245.497307:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967399 is committed 00000004:00080000:3.0:1787365245.497333:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 3 committed 00000020:00080000:3.0:1787365245.497359:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f278fd56f00 refcount 2 committed 0 result 0 batchid 3 00000020:00080000:3.0:1787365245.497364:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f27bf0a5e00 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f278fd56900 00000020:00080000:3.0:1787365245.497367:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f27bf0a5000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f2798029400 00000004:00080000:3.0:1787365245.497387:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 5 committed 00000004:00080000:3.0:1787365245.497406:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 6 committed 00000020:00080000:3.0:1787365245.497423:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f27abe5d240 refcount 2 committed 0 result 0 batchid 2 00000020:00080000:3.0:1787365245.497426:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f27879cbb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f27abe5da80 00000020:00080000:3.0:1787365245.497428:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f27879cba00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f27bbbe6800 00000001:00080000:3.0:1787365245.497440:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967400 is committed 00000100:00100000:3.0:1787365245.497605:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2686973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024484864:0@lo:6:osp-syn-1-0.0 00000100:00100000:3.0:1787365245.497693:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365245.497917:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb841180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+15:10547:x1874188003500544:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 58723us (58976us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365245.497927:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 124 00000020:00080000:2.0:1787365245.497957:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 3 committed batchid 1 00000020:00080000:2.0:1787365245.498125:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000100:00100000:3.0:1787365245.498665:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787365245.498678:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024484992:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787365245.498712:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365245.498833:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024484992 00000100:00100000:0.0:1787365245.498841:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024484992 00000100:00080000:3.0:1787365245.498874:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787365245.498885:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:0.0:1787365245.498895:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024484992:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:0.0:1787365245.498919:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:3 count 1 00002000:00010000:0.0:1787365245.498949:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x3:0x0] initial LVB size: 9, mtime: 0x6a89077a, atime: 0x6a89077b, ctime: 0x6a89077a, blocks: 0xb 00000100:00100000:2.0:1787365245.498955:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024484864 00010000:00010000:0.0:1787365245.498957:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e54b2d82/0x872d29295eb4752a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365245.498959:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024484864 00010000:00010000:0.0:1787365245.498972:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=362s v=(0 0) 00010000:00010000:0.0:1787365245.498977:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x3:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365245.498983:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e54b2d82/0x872d29295eb4752a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.498999:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e54b2d82/0x872d29295eb4752a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365245.499023:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:2.0:1787365245.499031:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2686972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1874188024484864:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:2.0:1787365245.499042:0:10260:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:3 count 1 00010000:00010000:2.0:1787365245.499056:0:10260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb47531 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.499070:0:10260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000008e796b9/0x872d29295eb472ec lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989115 expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.499078:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x3:0x0].0x0 since=2s v=(0 0) 00010000:00010000:2.0:1787365245.499081:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787365245.499085:0:10260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb47531 lrc: 4/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.499109:0:10260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000008e796b9/0x872d29295eb472ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989115 expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.499123:0:10260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000008e796b9/0x872d29295eb472ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989115 expref: 11 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365245.499136:0:10260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2788f8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10260:1874188024485120:192.168.203.13@tcp:104: 00000100:00100000:2.0:1787365245.499206:0:10260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473f0c0 going to sleep for 11 seconds 00010000:00010000:0.0:1787365245.500050:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e54b2d82/0x872d29295eb4752a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.500058:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e54b2d82/0x872d29295eb4752a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.500082:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787365245.500647:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3311:x1874188024484992:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1733us (1912us total) trans 4294967304 rc 0/0 00000100:00100000:0.0:1787365245.500656:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00010000:00010000:2.0:1787365245.501034:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787365245.501041:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e54b2d82/0x872d29295eb4752a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.501064:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780031a00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:2.0:1787365245.501068:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e54b2d82/0x872d29295eb4752a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.501076:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e54b2d82/0x872d29295eb4752a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787365245.501084:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f27bb840e00/2, rc 0, transno 4294967304 00000100:00100000:3.0:1787365245.501090:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb840e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024484992:0@lo:6:osp-syn-0-0.0 00010000:00010000:2.0:1787365245.501092:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e54b2d82/0x872d29295eb4752a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.501099:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e54b2d82/0x872d29295eb4752a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.501116:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365245.501118:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365245.501120:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365245.501942:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365245.501970:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003500672 00000100:00100000:3.0:1787365245.501983:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003500672 00000100:00100000:2.0:1787365245.502064:0:10260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2788f8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10260:1874188024485120:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365245.502084:0:10260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb47531 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365245.502176:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:3.0:1787365245.502196:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+12:2359:x1874188003500672:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787365245.504773:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365245.504807:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003500800 00000100:00100000:3.0:1787365245.504816:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003500800 00010000:00010000:3.0:1787365245.504849:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000008e796b9/0x872d29295eb472ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989115 expref: 13 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365245.504926:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:3.0:1787365245.504936:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:2362:x1874188003500800:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365245.504950:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365245.504958:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000008e796b9/0x872d29295eb472ec lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989115 expref: 13 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365245.504971:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000008e796b9/0x872d29295eb472ec lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989115 expref: 13 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365245.504992:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000008e796b9/0x872d29295eb472ec lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989115 expref: 13 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365245.505007:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787365245.505012:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x3:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787365245.505017:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb47531 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365245.505040:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb47531 lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090080000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365245.505067:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365245.505117:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f3100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+12:2362:x1874188003500800:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 183us (352us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365245.505124:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00010000:00010000:3.0:1787365245.505153:0:10260:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb47531 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365245.505161:0:10260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb47531 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365245.505170:0:10260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb47531 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365245.505177:0:10260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb47531 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365245.505203:0:10260:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:3.0:1787365245.505729:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2686972d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+7:3313:x1874188024484864:12345-0@lo:6:osp-syn-1-0.0 Request processed in 6697us (8034us total) trans 4294967309 rc 0/0 00000100:00100000:3.0:1787365245.505737:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00010000:00010000:3.0:1787365245.505758:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365245.505764:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb47531 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365245.505780:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709000 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365245.505784:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb47531 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365245.508251:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb47531 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365245.508291:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb47531 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365245.508300:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000057d69b3e/0x872d29295eb47531 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x3:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365245.508321:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365245.508323:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365245.508326:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:3.0:1787365245.508378:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2686973100/2, rc 0, transno 4294967309 00000100:00100000:3.0:1787365245.508395:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2686973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024484864:0@lo:6:osp-syn-1-0.0 00000001:00080000:3.0:1787365245.589219:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967306 is committed 00000001:00080000:3.0:1787365245.589238:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967308 is committed 00000001:00080000:3.0:1787365245.589246:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967305 is committed 00000100:00100000:2.0:1787365245.589457:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2359:x1874188003500672:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 87268us (87512us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365245.589469:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:3.0:1787365245.593091:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365245.593233:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003501056 00000100:00100000:0.0:1787365245.593241:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003501056 00000100:00100000:0.0:1787365245.593300:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:0.0:1787365245.593310:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+15:10547:x1874188003501056:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787365245.593373:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365245.593411:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb47515 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891a8 expref: 15 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.593431:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f27988df700) 00010000:00010000:0.0:1787365245.593436:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787365245.593464:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47538 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.593478:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.593505:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787365245.593999:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000459dfe28 reply state 00000000cbe7f3c4 transno 4294967401 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365245.594009:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787365245.594100:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+16:10547:x1874188003501056:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 790us (1016us total) trans 4294967401 rc 0/0 00000100:00100000:0.0:1787365245.594108:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 125 00010000:00010000:1.0:1787365245.597169:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47538 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.597195:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47538 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.597204:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47538 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.597210:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365245.597214:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47538 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.597223:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47538 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.597238:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f27988df700) 00010000:00010000:1.0:1787365245.597241:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365245.597246:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47538 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.597252:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb47538 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365245.605894:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365245.605998:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003501184 00000100:00100000:0.0:1787365245.606008:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003501184 00000100:00100000:0.0:1787365245.606061:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:0.0:1787365245.606071:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2362:x1874188003501184:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787365245.606282:0:6680:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:0.0:1787365245.606286:0:6680:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787365243 00002000:00010000:0.0:1787365245.606289:0:6680:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787365243 00002000:00010000:0.0:1787365245.606291:0:6680:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787365244 -> 1787365243 00002000:00010000:0.0:1787365245.606293:0:6680:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:0.0:1787365245.606358:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaae680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2362:x1874188003501184:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 288us (474us total) trans 4294967310 rc 0/0 00000100:00100000:0.0:1787365245.606367:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:3.0:1787365245.610041:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365245.610143:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003501440 00000100:00100000:1.0:1787365245.610152:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003501440 00000100:00100000:1.0:1787365245.610219:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00100000:1.0:1787365245.610246:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+15:10547:x1874188003501440:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:1.0:1787365245.610316:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4753f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.610335:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb474f9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898919a expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.610345:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4753f lrc: 4/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.610383:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb474f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898919a expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.610408:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb474f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898919a expref: 15 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365245.610421:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874188024485248:192.168.203.13@tcp:104: 00000100:00100000:1.0:1787365245.610515:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2684531f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787365245.613766:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c4000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874188024485248:192.168.203.13@tcp:104: 00010000:00010000:1.0:1787365245.613796:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4753f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365245.614938:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365245.616310:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003501568 00000100:00100000:0.0:1787365245.616321:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003501568 00010000:00010000:2.0:1787365245.616507:0:8434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb474f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898919a expref: 16 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365245.616563:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:2.0:1787365245.616573:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+16:2361:x1874188003501568:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787365245.616588:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365245.616595:0:8434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb474f9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898919a expref: 16 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.616607:0:8434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb474f9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898919a expref: 16 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.616648:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb474f9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x9:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898919a expref: 16 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.616665:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f27988df700) 00010000:00010000:2.0:1787365245.616670:0:8434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4753f lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.616678:0:8434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4753f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.616685:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4753f lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.616718:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365245.616776:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaad500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+15:2361:x1874188003501568:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 204us (1841us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365245.616784:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00010000:00010000:0.0:1787365245.616816:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4753f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.616826:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4753f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.616858:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4753f lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.616865:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4753f lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.616871:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4753f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.616878:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798115800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365245.616882:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4753f lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.616891:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4753f lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.616901:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f27988df700) 00010000:00010000:0.0:1787365245.616905:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787365245.616919:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4753f lrc: 2/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.616925:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb4753f lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365245.616969:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaae300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:10547:x1874188003501440:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 6725us (6937us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787365245.616979:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 126 00000100:00100000:3.0:1787365245.620906:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365245.620995:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003501696 00000100:00100000:2.0:1787365245.621018:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003501696 00000100:00100000:2.0:1787365245.621075:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:2.0:1787365245.621084:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2362:x1874188003501696:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:2.0:1787365245.621127:0:10260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fd228749/0x872d29295eb47546 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.621146:0:10260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000044c7ae50/0x872d29295eb47523 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891b6 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.621155:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365245.621159:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787365245.621164:0:10260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd228749/0x872d29295eb47546 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.621207:0:10260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000044c7ae50/0x872d29295eb47523 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891b6 expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.621222:0:10260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000044c7ae50/0x872d29295eb47523 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891b6 expref: 7 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365245.621237:0:10260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2788f8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10260:1874188024485376:192.168.203.13@tcp:104: 00000100:00100000:2.0:1787365245.621312:0:10260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473f0c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365245.626043:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365245.626136:0:10260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2788f8d180 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0001_UUID:10260:1874188024485376:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365245.626161:0:10260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 00000000fd228749/0x872d29295eb47546 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365245.626238:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003501824 00000100:00100000:0.0:1787365245.626245:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003501824 00010000:00010000:0.0:1787365245.626280:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000044c7ae50/0x872d29295eb47523 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891b6 expref: 8 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365245.626331:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:0.0:1787365245.626341:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2362:x1874188003501824:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787365245.626356:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365245.626377:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000044c7ae50/0x872d29295eb47523 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891b6 expref: 8 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.626390:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000044c7ae50/0x872d29295eb47523 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891b6 expref: 8 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.626423:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044c7ae50/0x872d29295eb47523 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891b6 expref: 8 pid: 6681 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.626440:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787365245.626445:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787365245.626450:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000fd228749/0x872d29295eb47546 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.626461:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fd228749/0x872d29295eb47546 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.626491:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365245.626546:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaad180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2362:x1874188003501824:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 206us (511us total) trans 0 rc 0/0 00010000:00010000:2.0:1787365245.626551:0:10260:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 00000000fd228749/0x872d29295eb47546 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365245.626558:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00010000:00010000:2.0:1787365245.626564:0:10260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fd228749/0x872d29295eb47546 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.626603:0:10260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 00000000fd228749/0x872d29295eb47546 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.626612:0:10260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fd228749/0x872d29295eb47546 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.626620:0:10260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fd228749/0x872d29295eb47546 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.626661:0:10260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709400 already unused, calling callback (ffffffffc1672420) 00010000:00010000:2.0:1787365245.626666:0:10260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd228749/0x872d29295eb47546 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.626680:0:10260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fd228749/0x872d29295eb47546 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.626693:0:10260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fd228749/0x872d29295eb47546 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.626712:0:10260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fd228749/0x872d29295eb47546 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365245.626758:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaad880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2362:x1874188003501696:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 5672us (5859us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365245.626766:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:1.0:1787365245.629809:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365245.629985:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003502080 00000100:00100000:0.0:1787365245.629994:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003502080 00000100:00100000:0.0:1787365245.630056:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 127 00000100:00100000:0.0:1787365245.630067:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:10547:x1874188003502080:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787365245.630900:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4754d lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.630921:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4754d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.630934:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4754d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.631388:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115a00/0x872d29295eb47554 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.631469:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47507 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891a1 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.631500:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115a00/0x872d29295eb47554 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.631535:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47507 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891a1 expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.631549:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47507 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891a1 expref: 15 pid: 5835 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365245.631563:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874188024485504:192.168.203.13@tcp:104: 00000100:00100000:1.0:1787365245.631885:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f26845313c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365245.635454:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874188024485504:192.168.203.13@tcp:104: 00010000:00010000:3.0:1787365245.635484:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115a00/0x872d29295eb47554 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365245.640314:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365245.640602:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003502208 00000100:00100000:3.0:1787365245.640611:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003502208 00010000:00010000:3.0:1787365245.640698:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47507 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891a1 expref: 16 pid: 5835 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365245.640912:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:3.0:1787365245.640923:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+16:2362:x1874188003502208:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365245.640938:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365245.640944:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47507 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891a1 expref: 16 pid: 5835 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365245.640957:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47507 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891a1 expref: 16 pid: 5835 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365245.640980:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47507 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891a1 expref: 16 pid: 5835 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365245.640995:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f27988df700) 00010000:00010000:3.0:1787365245.641000:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115a00/0x872d29295eb47554 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365245.641009:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115a00/0x872d29295eb47554 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365245.641035:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115a00/0x872d29295eb47554 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365245.641067:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365245.641125:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+15:2362:x1874188003502208:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 203us (820us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365245.641132:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00010000:00010000:1.0:1787365245.641428:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115a00/0x872d29295eb47554 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.641436:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115a00/0x872d29295eb47554 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787365245.641601:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967402 00000001:00080000:1.0:1787365245.641932:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967403 00000001:00080000:1.0:1787365245.641983:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967404 00000100:00100000:1.0:1787365245.642062:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874188024485632:0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787365245.642111:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365245.642143:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bcf84840 going to sleep for 11 seconds 00000100:00100000:0.0:1787365245.642352:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024485632 00000100:00100000:0.0:1787365245.642358:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024485632 00000100:00100000:0.0:1787365245.642406:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787365245.642414:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1874188024485632:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787365245.642495:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1874188024485632:12345-0@lo:1000:mdt00_000.0 Request processed in 83us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365245.642502:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:2.0:1787365245.642583:0:5833:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967305 gen 2 00000004:00080000:2.0:1787365245.642589:0:5833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967305 committed transno 4294967305 00000100:00100000:2.0:1787365245.642610:0:5833:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9f2686973100 x1874188024484864/t4294967309(4294967309) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787365261 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365245.642621:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c5f80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874188024485632:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787365245.643211:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967405 00000100:00100000:2.0:1787365245.643273:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2788f8d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874188024485760:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787365245.643308:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365245.643336:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2684531cc0 going to sleep for 11 seconds 00000100:00100000:0.0:1787365245.643465:0:5838:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024485760 00000100:00100000:0.0:1787365245.643471:0:5838:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024485760 00000100:00100000:0.0:1787365245.643492:0:5838:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787365245.643498:0:5838:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:5833:x1874188024485760:12345-0@lo:1000:mdt00_000.0 00000100:00100000:0.0:1787365245.643670:0:5838:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:5833:x1874188024485760:12345-0@lo:1000:mdt00_000.0 Request processed in 171us (361us total) trans 4294967311 rc 0/0 00000100:00100000:0.0:1787365245.643687:0:5838:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:2.0:1787365245.643848:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2788f8d180 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874188024485760:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787365245.643878:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115a00/0x872d29295eb47554 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.643888:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115a00/0x872d29295eb47554 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.643895:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115a00/0x872d29295eb47554 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.643901:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798115a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365245.644050:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115a00/0x872d29295eb47554 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.644058:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115a00/0x872d29295eb47554 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.644072:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f27988df700) 00010000:00010000:2.0:1787365245.644075:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787365245.644079:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115a00/0x872d29295eb47554 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.644086:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115a00/0x872d29295eb47554 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x9:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.644115:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47497 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.644122:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47497 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.644128:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47497 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.644133:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2045a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365245.644136:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47497 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.644142:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47497 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.644150:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:2.0:1787365245.644153:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787365245.644166:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4749e lrc: 2/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989185 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.644178:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4749e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989185 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.644196:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4749e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989185 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.644223:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4749e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989185 expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365245.644233:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874188024485888:192.168.203.13@tcp:105: 00000100:00100000:2.0:1787365245.644294:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2684531cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787365245.649384:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874188024485888:192.168.203.13@tcp:105: 00010000:00010000:2.0:1787365245.649535:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47497 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.649548:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47497 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.649580:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb4755b lrc: 3/0,1 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.649599:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb4755b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.649611:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb4755b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365245.650005:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00010000:00010000:2.0:1787365245.650453:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb4755b lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.650459:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb4755b lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.650465:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb4755b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.650470:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365245.650473:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb4755b lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.650480:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb4755b lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.650491:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:2.0:1787365245.650494:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365245.650497:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb4755b lrc: 2/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.650503:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb4755b lrc: 0/0,0 mode: --/EX res: [0x200000401:0x7:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.650512:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4754d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.650519:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4754d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.650524:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4754d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.650536:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365245.650539:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4754d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.650546:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4754d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.650554:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:2.0:1787365245.650556:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787365245.650559:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4754d lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.650564:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4754d lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365245.651226:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:10547:x1874188003502080:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 21157us (21421us total) trans 4294967406 rc 0/0 00000100:00100000:2.0:1787365245.651238:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 127 00000020:00080000:2.0:1787365245.651244:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:1.0:1787365245.651664:0:11946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003502336 00000100:00100000:1.0:1787365245.651673:0:11946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003502336 00000100:00100000:1.0:1787365245.651736:0:11946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:1.0:1787365245.651746:0:11946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:10545:x1874188003502336:12345-192.168.203.13@tcp:49:lfs.0 00000100:00100000:1.0:1787365245.651854:0:11946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:10545:x1874188003502336:12345-192.168.203.13@tcp:49:lfs.0 Request processed in 108us (1850us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365245.651861:0:11946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00000040:00080000:0.0:1787365245.653039:0:11664:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787365245.653051:0:11664:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787365245.653537:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 3 00000040:00080000:0.0:1787365245.653546:0:11664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787365245.656147:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365245.656214:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365245.656303:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003502592 00000100:00100000:2.0:1787365245.656312:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003502592 00000100:00100000:2.0:1787365245.656375:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:2.0:1787365245.656386:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:10545:x1874188003502592:12345-192.168.203.13@tcp:58:lfs.0 00000040:00080000:2.0:1787365245.656781:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].3, 136 off8600 00000100:00100000:2.0:1787365245.656858:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb840000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:10545:x1874188003502592:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 474us (719us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365245.656865:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 128 00000100:00100000:1.0:1787365245.660026:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003502848 00000100:00100000:1.0:1787365245.660042:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003502848 00000100:00100000:1.0:1787365245.660142:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:1.0:1787365245.660152:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278ac6f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:10547:x1874188003502848:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:1.0:1787365245.660856:0:5837:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x9:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:1.0:1787365245.660973:0:5837:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967407 00010000:00010000:1.0:1787365245.661032:0:5837:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb47562 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.661049:0:5837:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb47562 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.661061:0:5837:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb47562 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.661069:0:5837:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb47562 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.661075:0:5837:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb47562 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.661082:0:5837:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb47562 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.661108:0:5837:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787365245.661210:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278ac6f450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+20:10547:x1874188003502848:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 1058us (4994us total) trans 4294967408 rc 0/0 00000100:00100000:1.0:1787365245.661231:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000020:00080000:1.0:1787365245.661237:0:5837:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787365245.664688:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365245.664702:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb47562 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.664714:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798115800 already unused, calling callback (ffffffffc1672420) 00010000:00010000:0.0:1787365245.664719:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb47562 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.664737:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb47562 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.664753:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x9:0x0].0x0 (ffff9f2784761800) 00010000:00010000:0.0:1787365245.664756:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787365245.664761:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb47562 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.664766:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115800/0x872d29295eb47562 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x9:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5837 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365245.664788:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365245.664790:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365245.664792:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365245.693113:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365245.693219:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003502976 00000100:00100000:2.0:1787365245.693242:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003502976 00000100:00100000:2.0:1787365245.693303:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 129 00000100:00100000:2.0:1787365245.693313:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+20:10549:x1874188003502976:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1787365245.693338:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365245.693359:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47569 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989891bd expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.693439:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb47570 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.693452:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb47570 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.693463:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb47570 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.693477:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47577 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.693484:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.693489:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.694094:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708e00/0x872d29295eb4757e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.694109:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47489 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898917e expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.694117:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708e00/0x872d29295eb4757e lrc: 4/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.694156:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47489 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898917e expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365245.694171:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47489 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898917e expref: 21 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365245.694194:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bf0f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874188024486016:192.168.203.13@tcp:104: 00000100:00100000:2.0:1787365245.694283:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2797aeccc0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365245.697091:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365245.697237:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bf0f3b80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874188024486016:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365245.697268:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708e00/0x872d29295eb4757e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365245.698090:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003503232 00000100:00100000:0.0:1787365245.698100:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003503232 00000100:00100000:2.0:1787365245.698519:0:11946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:2.0:1787365245.698531:0:11946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+22:5596:x1874188003503232:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:2.0:1787365245.698806:0:11946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaadc00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+23:5596:x1874188003503232:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 277us (1722us total) trans 4294967409 rc 0/0 00000100:00100000:2.0:1787365245.698814:0:11946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:3.0:1787365245.702577:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365245.702651:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003503360 00000100:00100000:1.0:1787365245.702661:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003503360 00010000:00010000:1.0:1787365245.702702:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47489 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898917e expref: 23 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365245.702754:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:1.0:1787365245.702776:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+23:2361:x1874188003503360:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365245.702795:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365245.702802:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47489 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898917e expref: 23 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.702816:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47489 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898917e expref: 23 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.702837:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47489 lrc: 0/0,0 mode: --/CW res: [0x200000401:0x7:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898917e expref: 23 pid: 5834 timeout: 462 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.702855:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:1.0:1787365245.702861:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708e00/0x872d29295eb4757e lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.702871:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708e00/0x872d29295eb4757e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.702878:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708e00/0x872d29295eb4757e lrc: 4/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.702945:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365245.703601:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaaca80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+22:2361:x1874188003503360:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 834us (1028us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365245.703610:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00010000:00010000:1.0:1787365245.704668:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708e00/0x872d29295eb4757e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.704902:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708e00/0x872d29295eb4757e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787365245.704945:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00000004:00200000:1.0:1787365245.704950:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:1.0:1787365245.704969:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708e00/0x872d29295eb4757e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.704983:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708e00/0x872d29295eb4757e lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.704993:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb47570 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.704999:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb47570 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.705005:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb47570 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.705011:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365245.705015:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb47570 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.705039:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb47570 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.705052:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:1.0:1787365245.705055:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365245.705059:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb47570 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.705065:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb47570 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.705079:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47577 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.705085:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47577 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.705090:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.705096:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365245.705099:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47577 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.705104:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47577 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.705111:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x238769cd (ffff9f27988df700) 00010000:00010000:1.0:1787365245.705114:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365245.705117:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47577 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.705133:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47577 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x238769cd bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.705175:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47569 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891bd expref: 22 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.705198:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708e00/0x872d29295eb4757e lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891bd expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365245.705205:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:1.0:1787365245.705207:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:1.0:1787365245.705209:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb708e00, rc 0) 00000100:00100000:1.0:1787365245.705262:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb841f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:10549:x1874188003502976:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 11950us (12158us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365245.705269:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 129 00010000:00010000:2.0:1787365246.323784:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787365246.579205:0:12038:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787365246.579215:0:12038:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787365246.579259:0:12038:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787365246.579266:0:12038:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:1.0:1787365246.721272:0:11664:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787365246.721281:0:11664:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787365246.721334:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787365246.721341:0:11664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787365246.721447:0:11664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c5880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11664:1874188024486144:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:1.0:1787365246.721617:0:11664:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b66d9000 going to sleep for 11 seconds 00000100:00100000:3.0:1787365246.725727:0:11664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c5880 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11664:1874188024486144:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787365246.733531:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365246.733622:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003503488 00000100:00100000:1.0:1787365246.733644:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003503488 00000100:00080000:2.0:1787365246.733724:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365246.733725:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 130 00000100:00100000:1.0:1787365246.733737:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:10561:x1874188003503488:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787365246.733771:0:6704:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0x7:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787365246.733873:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:10561:x1874188003503488:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 139us (351us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365246.733882:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 130 00000100:00100000:2.0:1787365246.742040:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365246.742074:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003503744 00000100:00100000:2.0:1787365246.742083:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003503744 00000100:00100000:2.0:1787365246.742128:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 131 00000100:00100000:2.0:1787365246.742137:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:10561:x1874188003503744:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365246.742169:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365246.742201:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb47585 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989891c4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365246.742292:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb4758c lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365246.742306:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb4758c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365246.742318:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb4758c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365246.742328:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:2.0:1787365246.742435:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb47585 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891c4 expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365246.742451:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb4758c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891c4 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365246.742460:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:2.0:1787365246.742463:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787365246.742466:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb709800, rc 0) 00000100:00100000:2.0:1787365246.742526:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+23:10561:x1874188003503744:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 389us (494us total) trans 4294967410 rc 0/0 00000100:00100000:2.0:1787365246.742533:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 131 00000100:00100000:2.0:1787365246.750606:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365246.750669:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365246.750701:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003504128 00000100:00100000:2.0:1787365246.750719:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003504128 00000100:00100000:2.0:1787365246.750769:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 132 00000100:00100000:2.0:1787365246.750778:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+23:10561:x1874188003504128:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:2.0:1787365246.750852:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb4759a lrc: 3/0,1 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365246.750869:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb4759a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365246.750885:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003503872 00000100:00100000:1.0:1787365246.750889:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003503872 00010000:00010000:2.0:1787365246.750895:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb4759a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365246.750923:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1787365246.750930:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+24:2362:x1874188003503872:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365246.750940:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365246.750957:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb4758c lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891c4 expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365246.750969:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:1.0:1787365246.750974:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365246.751018:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+23:2362:x1874188003503872:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 88us (420us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365246.751025:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00010000:00010000:2.0:1787365246.751065:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb4759a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365246.751074:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb4759a lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365246.751080:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb4759a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365246.751087:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365246.751091:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb4759a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365246.751099:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb4759a lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365246.751109:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:2.0:1787365246.751113:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787365246.751117:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb4759a lrc: 2/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365246.751135:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb4759a lrc: 0/0,0 mode: --/PW res: [0x200000401:0x7:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365246.751275:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+23:10561:x1874188003504128:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 496us (604us total) trans 4294967411 rc 0/0 00000100:00100000:2.0:1787365246.751283:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 132 00000040:00080000:3.0:1787365246.751490:0:11664:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787365246.751496:0:11664:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787365246.752372:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:3.0:1787365246.752382:0:11664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787365246.754251:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365246.754332:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003504384 00000100:00100000:3.0:1787365246.754341:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003504384 00000100:00100000:3.0:1787365246.754943:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:3.0:1787365246.754954:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+23:10561:x1874188003504384:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787365246.755165:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb842a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+24:10561:x1874188003504384:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 213us (922us total) trans 4294967412 rc 0/0 00000100:00100000:3.0:1787365246.755173:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00010000:00010000:0.0:1787365247.346785:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365248.370781:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365248.371018:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365248.371109:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003504512 00000100:00100000:1.0:1787365248.371119:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003504512 00000100:00100000:1.0:1787365248.371183:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 292 00000100:00100000:1.0:1787365248.371194:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2361:x1874188003504512:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365248.371279:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b5c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2361:x1874188003504512:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 88us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365248.371286:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 292 00000100:00100000:3.0:1787365248.375137:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365248.375242:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003504640 00000100:00100000:1.0:1787365248.375252:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003504640 00000100:00100000:1.0:1787365248.375330:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 149 00000100:00100000:1.0:1787365248.375341:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+24:2361:x1874188003504640:12345-192.168.203.13@tcp:400:kworker.0 00000100:00080000:3.0:1787365248.375386:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365248.375426:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787320000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+24:2361:x1874188003504640:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 87us (297us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365248.375434:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 149 00000100:00100000:3.0:1787365248.379491:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365248.379533:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365248.379648:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365248.379677:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003505024 00000100:00100000:3.0:1787365248.379687:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003505024 00000100:00100000:3.0:1787365248.379742:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00100000:3.0:1787365248.379752:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2362:x1874188003505024:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365248.379821:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2362:x1874188003505024:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 71us (173us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365248.379828:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00080000:3.0:1787365248.379933:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365248.382254:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003504896 00000100:00100000:2.0:1787365248.382264:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003504896 00000100:00100000:2.0:1787365248.382359:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003504768 00000100:00100000:2.0:1787365248.382363:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003504768 00000100:00100000:2.0:1787365248.382391:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:2.0:1787365248.382399:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb732a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2362:x1874188003504896:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1787365248.382469:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb732a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2362:x1874188003504896:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 70us (2985us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365248.382476:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:2.0:1787365248.382492:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:2.0:1787365248.382499:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2362:x1874188003504768:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1787365248.382523:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2362:x1874188003504768:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (2989us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365248.382529:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00080000:0.0:1787365248.385342:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787365248.385350:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000040:00080000:3.0:1787365248.443705:0:12089:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787365248.444814:0:12089:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787365248.444878:0:12089:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:3.0:1787365248.444883:0:12089:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787365248.639553:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365248.639749:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003505280 00000100:00100000:0.0:1787365248.639768:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003505280 00000100:00100000:0.0:1787365248.639819:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 133 00000100:00100000:0.0:1787365248.639829:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+24:10581:x1874188003505280:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1787365248.639849:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365248.639881:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb475a1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989891cb expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365248.639976:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb475a8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365248.639991:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb475a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365248.640003:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb475a8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365248.640014:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0x7:0x0]: returning size 0 00010000:00010000:0.0:1787365248.640285:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb475a1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891cb expref: 27 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365248.640301:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb475a8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891cb expref: 26 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365248.640309:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:0.0:1787365248.640312:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787365248.640315:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780030a00, rc 0) 00000100:00100000:0.0:1787365248.640437:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbfa680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+26:10581:x1874188003505280:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 609us (893us total) trans 4294967413 rc 0/0 00000100:00100000:0.0:1787365248.640446:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 133 00000100:00100000:0.0:1787365248.643542:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365248.643712:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003505408 00000100:00100000:3.0:1787365248.643721:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003505408 00000100:00100000:3.0:1787365248.643777:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 134 00000100:00100000:3.0:1787365248.643787:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+26:10581:x1874188003505408:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:3.0:1787365248.643853:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb475b6 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365248.643871:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb475b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365248.643884:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb475b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365248.643909:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb475b6 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365248.643926:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb475b6 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365248.643933:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb475b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365248.643939:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365248.643944:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb475b6 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365248.643952:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb475b6 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365248.643965:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:3.0:1787365248.643968:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787365248.643973:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb475b6 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365248.643980:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb475b6 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365248.644468:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb840700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+26:10581:x1874188003505408:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 681us (933us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365248.644476:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 134 00000100:00100000:3.0:1787365248.780438:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365248.780600:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003505536 00000100:00100000:2.0:1787365248.780610:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003505536 00000100:00100000:2.0:1787365248.780696:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:2.0:1787365248.780706:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2359:x1874188003505536:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:2.0:1787365248.780723:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365248.780757:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000084806f8e/0x872d29295eb475bd lrc: 2/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989891d2 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:2.0:1787365248.780783:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a89077b, atime: 0x6a89077b, ctime: 0x6a89077b, blocks: 0xb 00010000:00010000:2.0:1787365248.780807:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=365s v=(0 0) 00010000:00010000:2.0:1787365248.780812:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365248.780822:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000084806f8e/0x872d29295eb475bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891d2 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365248.780841:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000084806f8e/0x872d29295eb475bd lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891d2 expref: 7 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365248.780854:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb708200, rc 0) 00000100:00100000:2.0:1787365248.780926:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2359:x1874188003505536:12345-192.168.203.13@tcp:101:cat.0 Request processed in 220us (495us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365248.780933:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:1.0:1787365248.793815:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365248.793900:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003505664 00000100:00100000:0.0:1787365248.793910:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003505664 00002000:00100000:0.0:1787365248.793960:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9f27b63c7480 x1874188003505664/t0(0) o3->8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp:154/0 lens 488/0 e 0 to 0 dl 1787365259 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787365248.793970:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f27b63c7480 with x1874188003505664 ext(0->4095) 00002000:00010000:0.0:1787365248.793976:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f27b63c7480 00000100:00100000:0.0:1787365248.794015:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:0.0:1787365248.794025:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2360:x1874188003505664:12345-192.168.203.13@tcp:3:cat.0 00000100:00100000:0.0:1787365248.795741:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c7480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2360:x1874188003505664:12345-192.168.203.13@tcp:3:cat.0 Request processed in 1706us (1923us total) trans 0 rc 4096/4096 00000100:00100000:0.0:1787365248.795755:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00002000:00100000:0.0:1787365248.795767:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x4:0x0] (0->4095) req@ffff9f27b63c7480 x1874188003505664/t0(0) o3->8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp:154/0 lens 488/4536 e 0 to 0 dl 1787365259 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787365248.795778:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f27b63c7480 with x1874188003505664 ext(0->4095) 00002000:00010000:0.0:1787365248.795783:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f27b63c7480 00000100:00100000:1.0:1787365248.884295:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787365248.884317:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024486272:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787365248.884403:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365248.884664:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024486272 00000100:00100000:2.0:1787365248.884673:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024486272 00000100:00100000:2.0:1787365248.884750:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:2.0:1787365248.884760:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874188024486272:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787365248.884796:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365248.884844:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874188024486272:12345-0@lo:13:osp-pre-0-0.0 Request processed in 85us (440us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365248.884851:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00080000:0.0:1787365248.884911:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787365248.885558:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024486272:0@lo:13:osp-pre-0-0.0 00010000:00010000:0.0:1787365249.394943:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787365249.546082:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967304 is committed 00000004:00080000:0.0:1787365249.913580:0:8089:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 367077952367ns, next at 368077949488ns, rc = 0 00000100:00100000:0.0:1787365249.913608:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024486400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787365249.913696:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365249.913774:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024486400 00000100:00100000:0.0:1787365249.913789:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024486400 00000100:00100000:0.0:1787365249.913838:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:0.0:1787365249.913848:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27badf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874188024486400:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787365249.913885:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787365249.913930:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27badf0450 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874188024486400:12345-0@lo:13:osp-pre-1-0.0 Request processed in 83us (234us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365249.913937:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00080000:0.0:1787365249.914131:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787365249.914178:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024486400:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787365249.914878:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024486784:0@lo:400:kworker.0 00000100:00100000:0.0:1787365249.914913:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365249.914943:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787365249.914949:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024486656:0@lo:400:kworker.0 00000100:00100000:0.0:1787365249.914971:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365249.914997:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024486784 00000100:00100000:0.0:1787365249.915003:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024486784 00000100:00100000:0.0:1787365249.915039:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024486656 00000100:00100000:0.0:1787365249.915042:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024486656 00000100:00100000:0.0:1787365249.915060:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787365249.915067:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024486784:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365249.915107:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024486784:12345-0@lo:400:kworker.0 Request processed in 41us (192us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365249.915114:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 151 00000100:00100000:0.0:1787365249.915126:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 152 00000100:00100000:0.0:1787365249.915131:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024486656:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365249.915168:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024486656:12345-0@lo:400:kworker.0 Request processed in 36us (196us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365249.915184:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 152 00000100:00080000:0.0:1787365249.915206:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365249.915227:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb842680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024486656:0@lo:400:kworker.0 00000100:00100000:0.0:1787365249.915236:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb843100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024486784:0@lo:400:kworker.0 00000100:00100000:0.0:1787365249.915254:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024486912:0@lo:400:kworker.0 00000100:00100000:0.0:1787365249.915278:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365249.915311:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:0.0:1787365249.915316:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024486528:0@lo:400:kworker.0 00000100:00100000:0.0:1787365249.915340:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365249.915359:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024487040:0@lo:400:kworker.0 00000100:00100000:0.0:1787365249.915377:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365249.915396:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024486912 00000100:00100000:0.0:1787365249.915399:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024486912 00000100:00100000:0.0:1787365249.915420:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:1.0:1787365249.915807:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024487040 00000100:00100000:1.0:1787365249.915811:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024487040 00000100:00100000:1.0:1787365249.915846:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 153 00000100:00100000:1.0:1787365249.915853:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024487040:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365249.915897:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024487040:12345-0@lo:400:kworker.0 Request processed in 44us (518us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365249.915904:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 153 00000100:00080000:1.0:1787365249.915926:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365249.915944:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b56300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024487040:0@lo:400:kworker.0 00000100:00100000:1.0:1787365249.915977:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024486528 00000100:00100000:1.0:1787365249.915981:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024486528 00000100:00100000:1.0:1787365249.916004:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787365249.916010:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024486528:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365249.916055:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b4850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024486528:12345-0@lo:400:kworker.0 Request processed in 44us (713us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365249.916062:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 293 00000100:00100000:1.0:1787365249.916094:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024486528:0@lo:400:kworker.0 00000100:00100000:0.0:1787365249.918541:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024486912:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365249.918652:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024486912:12345-0@lo:400:kworker.0 Request processed in 3221us (3368us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365249.918662:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787365249.918785:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967304 gen 2 00000004:00080000:0.0:1787365249.918791:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f27bb840e00, transno 4294967304 00000100:00100000:0.0:1787365249.918804:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024486912:0@lo:400:kworker.0 00010000:00010000:3.0:1787365250.418937:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787365250.997440:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 7 committed 00000001:00080000:2.0:1787365250.997467:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967413 is committed 00000020:00080000:2.0:1787365250.997509:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f268473f600 refcount 2 committed 0 result 0 batchid 4 00000020:00080000:2.0:1787365250.997525:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f2783e36100 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f268473f0c0 00000020:00080000:2.0:1787365250.997529:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f2783e36c00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f27bbad5c00 00000020:00080000:1.0:1787365250.997570:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4 committed batchid 1 00000020:00080000:1.0:1787365250.997793:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 1 00000020:00080000:2.0:1787365250.998083:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 3 batchid updated 00000100:00100000:1.0:1787365250.998336:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024487168:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787365250.998402:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365250.998499:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024487168 00000100:00100000:2.0:1787365250.998506:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024487168 00000100:00100000:2.0:1787365250.998555:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787365250.998563:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3310:x1874188024487168:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:2.0:1787365250.999097:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:2.0:1787365250.999101:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb mtime from disk: 1787365243 -> 1787365243 00002000:00010000:2.0:1787365250.999104:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb atime from disk: 1787365243 -> 1787365243 00002000:00010000:2.0:1787365250.999106:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb ctime from disk: 1787365243 -> 1787365243 00002000:00010000:2.0:1787365250.999109:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x4:0x0] updating lvb blocks from disk: 11 -> 11 00000001:00080000:3.0:1787365251.000737:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967311 is committed 00000001:00080000:3.0:1787365251.000991:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967310 is committed 00000100:00100000:2.0:1787365251.001982:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874188024487168:12345-0@lo:2:osp-syn-1-0.0 Request processed in 3413us (3573us total) trans 4294967312 rc 0/0 00000100:00100000:2.0:1787365251.001996:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000004:00080000:0.0:1787365251.002139:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f27bb3c0700/2, rc 0, transno 4294967312 00000100:00100000:0.0:1787365251.002155:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024487168:0@lo:2:osp-syn-1-0.0 00010000:00010000:0.0:1787365251.442828:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:2.0:1787365251.895592:0:11664:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787365251.895600:0:11664:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787365251.896903:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 4 count 4 00000040:00080000:1.0:1787365251.896915:0:11664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787365252.471042:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365253.490763:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365253.498463:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365253.498501:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365253.498533:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365253.498562:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365253.498605:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365253.498655:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003506304 00000100:00100000:2.0:1787365253.498665:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003506304 00000100:00100000:2.0:1787365253.498718:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003505920 00000100:00100000:2.0:1787365253.498722:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003505920 00000100:00100000:2.0:1787365253.498744:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 154 00000100:00100000:2.0:1787365253.498753:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2359:x1874188003506304:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1787365253.498836:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2359:x1874188003506304:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 83us (301us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365253.498844:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 154 00000100:00100000:2.0:1787365253.498861:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 155 00000100:00100000:2.0:1787365253.498868:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:2359:x1874188003505920:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1787365253.498894:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:2359:x1874188003505920:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365253.498900:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 155 00000100:00080000:2.0:1787365253.498930:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365253.499045:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003506048 00000100:00100000:0.0:1787365253.499049:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003506048 00000100:00100000:0.0:1787365253.499096:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003506176 00000100:00100000:0.0:1787365253.499099:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003506176 00000100:00100000:0.0:1787365253.499143:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:0.0:1787365253.499153:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2359:x1874188003506048:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365253.499195:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2359:x1874188003506048:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 44us (693us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365253.499202:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:0.0:1787365253.499215:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:0.0:1787365253.499222:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2359:x1874188003506176:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365253.499247:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be5500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2359:x1874188003506176:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 25us (642us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365253.499253:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00080000:0.0:1787365253.499276:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787365253.499279:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787365253.505241:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003505792 00000100:00100000:3.0:1787365253.505256:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003505792 00000100:00100000:3.0:1787365253.505434:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 294 00000100:00100000:3.0:1787365253.505444:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27883b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2359:x1874188003505792:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365253.505512:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27883b7850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2359:x1874188003505792:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 70us (7059us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365253.505520:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 294 00000100:00100000:0.0:1787365254.002941:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024487296:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787365254.003010:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365254.003550:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024487296 00000100:00100000:2.0:1787365254.003558:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024487296 00000100:00100000:2.0:1787365254.003621:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787365254.003654:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024487296:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787365254.003685:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365254.003733:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb840e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024487296:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (723us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365254.003740:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787365254.003785:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6be6d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024487296:0@lo:13:osp-pre-0-0.0 00000100:00080000:0.0:1787365254.003908:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:1.0:1787365254.516241:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365254.732274:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365254.732397:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003506432 00000100:00100000:1.0:1787365254.732407:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003506432 00000100:00100000:1.0:1787365254.732473:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 135 00000100:00100000:1.0:1787365254.732483:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:10232:x1874188003506432:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 00000100:00100000:1.0:1787365254.732595:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:10232:x1874188003506432:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 Request processed in 112us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365254.732603:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 135 00000100:00100000:2.0:1787365254.735887:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365254.735956:0:11946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003506688 00000100:00100000:0.0:1787365254.735965:0:11946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003506688 00000100:00100000:0.0:1787365254.736022:0:11946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:0.0:1787365254.736032:0:11946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:10232:x1874188003506688:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:0.0:1787365254.736537:0:11946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:10232:x1874188003506688:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 497us (651us total) trans 4294967414 rc 0/0 00000100:00100000:0.0:1787365254.736556:0:11946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:1.0:1787365255.027194:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874188024487680:0@lo:400:kworker.0 00000100:00100000:1.0:1787365255.027260:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365255.027322:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024488192:0@lo:400:kworker.0 00000100:00100000:1.0:1787365255.027358:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365255.027390:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [2->3] 00000100:00100000:1.0:1787365255.027396:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024487552:0@lo:400:kworker.0 00000100:00100000:2.0:1787365255.027402:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024487936:0@lo:400:kworker.0 00000100:00100000:2.0:1787365255.027431:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365255.027432:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365255.027453:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024488064:0@lo:400:kworker.0 00000100:00100000:2.0:1787365255.027462:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:1.0:1787365255.027473:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365255.027503:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024488192 00000100:00100000:1.0:1787365255.027509:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024488192 00000100:00100000:1.0:1787365255.027559:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024487936 00000100:00100000:1.0:1787365255.027563:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024487936 00000100:00100000:1.0:1787365255.027584:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:1.0:1787365255.027592:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1874188024488192:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365255.027661:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+6:3313:x1874188024488192:12345-0@lo:400:kworker.0 Request processed in 69us (301us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365255.027668:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787365255.027677:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024487808:0@lo:400:kworker.0 00000100:00100000:1.0:1787365255.027685:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787365255.027691:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024487936:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365255.027702:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365255.027715:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024487936:12345-0@lo:400:kworker.0 Request processed in 25us (285us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365255.027721:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:1.0:1787365255.027738:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024487552 00000100:00100000:2.0:1787365255.027741:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbf8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024487936:0@lo:400:kworker.0 00000100:00100000:1.0:1787365255.027741:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024487552 00000100:00100000:1.0:1787365255.027763:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787365255.027769:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3313:x1874188024487552:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365255.027999:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e19450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3313:x1874188024487552:12345-0@lo:400:kworker.0 Request processed in 229us (565us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365255.028006:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 295 00000100:00100000:1.0:1787365255.028033:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024487680 00000100:00100000:1.0:1787365255.028037:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024487680 00000100:00100000:1.0:1787365255.028059:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024488064 00000100:00100000:1.0:1787365255.028068:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024488064 00000100:00100000:1.0:1787365255.028082:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024487808 00000100:00100000:1.0:1787365255.028084:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024487808 00000100:00100000:1.0:1787365255.028097:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787365255.028103:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874188024487680:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365255.028148:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874188024487680:12345-0@lo:400:kworker.0 Request processed in 45us (888us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365255.028154:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 156 00000100:00100000:1.0:1787365255.028164:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787365255.028170:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024488064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365255.028195:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024488064:12345-0@lo:400:kworker.0 Request processed in 25us (721us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365255.028200:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 157 00000100:00100000:1.0:1787365255.028209:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 158 00000100:00100000:1.0:1787365255.028215:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024487808:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365255.028241:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024487808:12345-0@lo:400:kworker.0 Request processed in 27us (538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365255.028246:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 158 00000100:00080000:1.0:1787365255.028263:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787365255.028267:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787365255.028298:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024487552:0@lo:400:kworker.0 00000100:00100000:1.0:1787365255.028308:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024488064:0@lo:400:kworker.0 00000100:00100000:1.0:1787365255.028317:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874188024487680:0@lo:400:kworker.0 00000100:00100000:1.0:1787365255.028324:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967311 gen 2 00000004:00080000:1.0:1787365255.029140:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2686973100, transno 4294967309 00000004:00080000:1.0:1787365255.029170:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967311 committed transno 4294967311 00000100:00100000:1.0:1787365255.029194:0:3313:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9f27bb3c0700 x1874188024487168/t4294967312(4294967312) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787365266 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365255.029209:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbfb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024488192:0@lo:400:kworker.0 00000100:00100000:2.0:1787365255.029271:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbf9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024487808:0@lo:400:kworker.0 00000100:00100000:3.0:1787365255.034316:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024487424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787365255.034408:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365255.035198:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024487424 00000100:00100000:2.0:1787365255.035207:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024487424 00000100:00100000:2.0:1787365255.035267:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787365255.035278:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874188024487424:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787365255.035312:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365255.035380:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874188024487424:12345-0@lo:13:osp-pre-1-0.0 Request processed in 104us (970us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365255.035388:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787365255.035435:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb843b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024487424:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787365255.129418:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365255.131659:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003506816 00000100:00100000:1.0:1787365255.131672:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003506816 00000100:00080000:0.0:1787365255.131860:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365255.131923:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 136 00000100:00100000:1.0:1787365255.131935:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:11035:x1874188003506816:12345-192.168.203.13@tcp:101:lsof.0 00010000:00010000:1.0:1787365255.131955:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365255.131977:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb475c4 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989891d9 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365255.132047:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb475cb lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365255.132061:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb475cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365255.132073:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb475cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787365255.132275:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787365255.132279:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:1.0:1787365255.132394:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb475cb lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365255.132420:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb475c4 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891d9 expref: 7 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365255.132438:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb475cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891d9 expref: 6 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365255.132454:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2789e48c00) 00010000:00010000:1.0:1787365255.132457:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787365255.132461:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115200, rc 0) 00000100:00100000:1.0:1787365255.132534:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c868fdb9-61c7-472a-bd37-21cfd41249aa+6:11035:x1874188003506816:12345-192.168.203.13@tcp:101:lsof.0 Request processed in 602us (3125us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365255.132542:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 136 00010000:00010000:0.0:1787365255.540246:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787365256.129456:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967414 is committed 00000020:00080000:2.0:1787365256.129471:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 4 batchid updated 00000020:00080000:1.0:1787365256.129855:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000020:00080000:1.0:1787365256.129874:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000001:00080000:1.0:1787365256.141489:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967312 is committed 00010000:00010000:1.0:1787365256.563693:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365257.591085:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365258.610801:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365258.611156:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365258.611193:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365258.611234:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003506944 00000100:00100000:3.0:1787365258.611244:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003506944 00000100:00100000:2.0:1787365258.611274:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365258.611298:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 296 00000100:00100000:2.0:1787365258.611307:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365258.611313:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2360:x1874188003506944:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365258.611394:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e1a850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2360:x1874188003506944:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 84us (241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365258.611394:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365258.611406:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 296 00000100:00100000:1.0:1787365258.611432:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003507328 00000100:00100000:1.0:1787365258.611437:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003507328 00000100:00100000:1.0:1787365258.611480:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003507200 00000100:00100000:1.0:1787365258.611484:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003507200 00000100:00100000:1.0:1787365258.611511:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:1.0:1787365258.611519:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2359:x1874188003507328:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365258.611563:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2359:x1874188003507328:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 45us (289us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365258.611569:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:1.0:1787365258.611584:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:1.0:1787365258.611590:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2359:x1874188003507200:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365258.611612:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2359:x1874188003507200:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 22us (307us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365258.611617:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00080000:1.0:1787365258.611671:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787365258.611675:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787365258.612070:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003507072 00000100:00100000:0.0:1787365258.612075:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003507072 00000100:00100000:3.0:1787365258.612204:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003507456 00000100:00100000:3.0:1787365258.612209:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003507456 00000100:00100000:1.0:1787365258.612317:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 159 00000100:00100000:1.0:1787365258.612329:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:2360:x1874188003507072:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365258.612385:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:2360:x1874188003507072:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 59us (1190us total) trans 0 rc 0/0 00000100:00080000:0.0:1787365258.612516:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365258.612573:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 159 00000100:00100000:3.0:1787365258.614004:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 160 00000100:00100000:3.0:1787365258.614016:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+6:2359:x1874188003507456:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365258.615517:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+6:2359:x1874188003507456:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 1495us (4117us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365258.615530:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 160 00000001:02000400:3.0:1787365258.867339:0:12294:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1b: Test manual lfs pcc attach with restore on remote access ========================================================== 22:20:56 (1787365256) 00000100:00100000:3.0:1787365259.122937:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787365259.122959:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024488320:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787365259.123042:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365259.123169:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024488320 00000100:00100000:2.0:1787365259.123177:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024488320 00000100:00100000:2.0:1787365259.123243:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787365259.123254:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024488320:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787365259.123287:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365259.123333:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbfb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024488320:12345-0@lo:13:osp-pre-0-0.0 Request processed in 81us (291us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365259.123341:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:2.0:1787365259.123394:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f0e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024488320:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787365259.127409:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:0.0:1787365259.636198:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365260.147214:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024488832:0@lo:400:kworker.0 00000100:00100000:3.0:1787365260.147409:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365260.147564:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787365260.147572:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024488704:0@lo:400:kworker.0 00000100:00100000:3.0:1787365260.147687:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365260.147761:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024488832 00000100:00100000:3.0:1787365260.147775:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024488832 00000100:00100000:3.0:1787365260.147860:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787365260.147868:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024488832:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365260.147979:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb3b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024488832:12345-0@lo:400:kworker.0 Request processed in 111us (585us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365260.147986:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:3.0:1787365260.148022:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024488832:0@lo:400:kworker.0 00000100:00100000:2.0:1787365260.148334:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024488448:0@lo:400:kworker.0 00000100:00100000:2.0:1787365260.148371:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365260.148396:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6cb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024488960:0@lo:400:kworker.0 00000100:00100000:2.0:1787365260.148416:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365260.148433:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:2.0:1787365260.148438:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024488576:0@lo:400:kworker.0 00000100:00100000:2.0:1787365260.148459:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365260.148478:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6cb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024489088:0@lo:400:kworker.0 00000100:00100000:2.0:1787365260.148498:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365260.148524:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024488704 00000100:00100000:2.0:1787365260.148528:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024488704 00000100:00100000:2.0:1787365260.148613:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024488960 00000100:00100000:2.0:1787365260.148617:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024488960 00000100:00100000:2.0:1787365260.148652:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024488576 00000100:00100000:2.0:1787365260.148655:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024488576 00000100:00100000:2.0:1787365260.148668:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787365260.148674:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024488704:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365260.148711:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024488704:12345-0@lo:400:kworker.0 Request processed in 36us (1028us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365260.148717:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 161 00000100:00100000:2.0:1787365260.148729:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787365260.148734:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024488960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365260.148763:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024488960:12345-0@lo:400:kworker.0 Request processed in 30us (346us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365260.148769:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 162 00000100:00100000:2.0:1787365260.148796:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787365260.148801:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024488576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365260.148828:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024488576:12345-0@lo:400:kworker.0 Request processed in 27us (367us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365260.148833:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 163 00000100:00100000:2.0:1787365260.148864:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024488448 00000100:00100000:2.0:1787365260.148867:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024488448 00000100:00100000:2.0:1787365260.148892:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 297 00000100:00100000:2.0:1787365260.148899:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024488448:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365260.149017:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024489088 00000100:00100000:1.0:1787365260.149022:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024489088 00000100:00100000:1.0:1787365260.149050:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787365260.149057:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024489088:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365260.149105:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f0380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024489088:12345-0@lo:400:kworker.0 Request processed in 48us (606us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365260.149111:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00080000:1.0:1787365260.149157:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787365260.149162:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365260.149194:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbf9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024488576:0@lo:400:kworker.0 00000100:00100000:1.0:1787365260.149202:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967312 gen 2 00000004:00080000:1.0:1787365260.149207:0:3312:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f27bb3c0700, transno 4294967312 00000100:00100000:1.0:1787365260.149216:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6cb1880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024489088:0@lo:400:kworker.0 00000100:00100000:1.0:1787365260.149226:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6cb2a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024488960:0@lo:400:kworker.0 00000100:00100000:3.0:1787365260.149939:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbf8000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024488704:0@lo:400:kworker.0 00000100:00100000:3.0:1787365260.149952:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787365260.149960:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024489216:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787365260.150123:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365260.150247:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024489216 00000100:00100000:1.0:1787365260.150252:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024489216 00000100:00100000:1.0:1787365260.150290:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787365260.150298:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024489216:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787365260.150335:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365260.150523:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e1bc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024488448:12345-0@lo:400:kworker.0 Request processed in 1623us (2150us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365260.150532:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 297 00000100:00100000:1.0:1787365260.150593:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb2a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024489216:12345-0@lo:13:osp-pre-1-0.0 Request processed in 296us (469us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365260.150600:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:3.0:1787365260.150670:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbf9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024488448:0@lo:400:kworker.0 00000100:00100000:0.0:1787365260.150737:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6cb3800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024489216:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787365260.607309:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365260.607405:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003507712 00000100:00100000:0.0:1787365260.607415:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003507712 00000100:00100000:0.0:1787365260.607493:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 137 00000100:00100000:0.0:1787365260.607504:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:11299:x1874188003507712:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787365260.607523:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365260.607544:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb475d2 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989891e0 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.607614:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb475d9 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.607670:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb475d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.607684:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb475d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.607701:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb475e0 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.607723:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb475e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.607743:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb475e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.608154:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb475e7 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.608166:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb475e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.608174:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb475e7 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365260.608184:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:0.0:1787365260.608363:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb475d9 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.608371:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb475d9 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.608379:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb475d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.608385:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365260.608390:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb475d9 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.608398:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb475d9 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.608420:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f27988df600) 00010000:00010000:0.0:1787365260.608423:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365260.608429:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb475d9 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.608436:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb475d9 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.608448:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb475e0 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.608454:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb475e0 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.608459:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb475e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.608464:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780031c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365260.608467:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb475e0 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.608474:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb475e0 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.608481:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9f278a0add00) 00010000:00010000:0.0:1787365260.608484:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365260.608487:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb475e0 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.608493:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb475e0 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.608893:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb475d2 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891e0 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.608910:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb475e7 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891e0 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.608918:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f27988dfd00) 00010000:00010000:0.0:1787365260.608920:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365260.608922:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27c2045800, rc 0) 00000100:00100000:0.0:1787365260.608978:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+15:11299:x1874188003507712:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1476us (1680us total) trans 4294967415 rc 0/0 00000100:00100000:0.0:1787365260.608985:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 137 00000100:00080000:1.0:1787365260.609330:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365260.620486:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365260.622620:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365260.623182:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003507968 00000100:00100000:0.0:1787365260.623192:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003507968 00000100:00100000:0.0:1787365260.623257:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:0.0:1787365260.623267:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27882bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+15:2360:x1874188003507968:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787365260.623281:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365260.623308:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb475e7 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891e0 expref: 15 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365260.623328:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f27988dfd00) 00010000:00010000:0.0:1787365260.623333:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365260.623393:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27882bb850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:2360:x1874188003507968:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 128us (782us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365260.623402:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:1.0:1787365260.624769:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003507840 00000100:00100000:1.0:1787365260.624780:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003507840 00000100:00100000:1.0:1787365260.624830:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 138 00000100:00100000:1.0:1787365260.624839:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:11299:x1874188003507840:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00000100:00100000:1.0:1787365260.624930:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:11299:x1874188003507840:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 92us (4452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365260.624938:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 138 00010000:00010000:1.0:1787365260.660316:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787365261.110143:0:11664:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787365261.110151:0:11664:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787365261.110659:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 3 count 1 00000040:00080000:1.0:1787365261.110667:0:11664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000001:00080000:3.0:1787365261.216363:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967415 is committed 00010000:00010000:0.0:1787365261.683973:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365262.546274:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365262.546698:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003508096 00000100:00100000:0.0:1787365262.546770:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003508096 00000100:00100000:0.0:1787365262.546973:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 139 00000100:00100000:0.0:1787365262.546986:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:11342:x1874188003508096:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1787365262.547005:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365262.547025:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb475f5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989891e7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.547094:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb475fc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:1.0:1787365262.547100:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787365262.547108:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb475fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.547121:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb475fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.547135:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47603 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.547141:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.547147:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.548051:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb475fc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.548061:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb475fc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.548088:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb475fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.548095:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2045400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365262.548098:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb475fc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.548107:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb475fc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.548120:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2789e48c00) 00010000:00010000:0.0:1787365262.548123:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365262.548128:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb475fc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.548134:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb475fc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.548147:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47603 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.548153:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47603 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.548159:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47603 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.548163:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2045800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365262.548166:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47603 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.548181:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47603 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.548191:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9f278a0ad600) 00010000:00010000:0.0:1787365262.548193:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365262.548196:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47603 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.548202:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47603 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.548236:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb475f5 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891e7 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.548247:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2789e48c00) 00010000:00010000:0.0:1787365262.548250:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365262.548254:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb475f5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891e7 expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.548263:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27c2045a00, rc 0) 00000100:00100000:0.0:1787365262.549689:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:11342:x1874188003508096:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 2700us (3417us total) trans 0 rc 301/301 00000100:00100000:0.0:1787365262.549768:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 139 00000100:00100000:3.0:1787365262.556566:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365262.556660:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003508352 00000100:00100000:0.0:1787365262.556670:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003508352 00000100:00100000:0.0:1787365262.556727:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00100000:0.0:1787365262.556738:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:11342:x1874188003508352:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:0.0:1787365262.556804:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365262.556830:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45400/0x872d29295eb46f73 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989020 expref: 13 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.556861:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2789e48c00) 00010000:00010000:0.0:1787365262.556866:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787365262.557163:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4760a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.557179:0:5834:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb475cb lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891d9 expref: 5 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.557189:0:5834:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4760a lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.557222:0:5834:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb475cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891d9 expref: 5 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.557237:0:5834:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb475cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891d9 expref: 5 pid: 5834 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365262.557252:0:5834:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb843800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874188024489344:192.168.203.13@tcp:104: 00000100:00100000:0.0:1787365262.557341:0:5834:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2686c77180 going to sleep for 11 seconds 00000100:00100000:0.0:1787365262.561691:0:5834:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb843800 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:5834:1874188024489344:192.168.203.13@tcp:104: 00010000:00010000:0.0:1787365262.561719:0:5834:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4760a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365262.565109:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365262.565359:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003508480 00000100:00100000:2.0:1787365262.565369:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003508480 00010000:00010000:2.0:1787365262.565439:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb475cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891d9 expref: 6 pid: 5834 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365262.565474:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:2.0:1787365262.565484:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c868fdb9-61c7-472a-bd37-21cfd41249aa+6:2361:x1874188003508480:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787365262.565498:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365262.565505:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb475cb lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891d9 expref: 6 pid: 5834 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.565533:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb475cb lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891d9 expref: 6 pid: 5834 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.565567:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb475cb lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891d9 expref: 6 pid: 5834 timeout: 479 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.565583:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2789e48c00) 00010000:00010000:2.0:1787365262.565588:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4760a lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.565596:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4760a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.565603:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4760a lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.565645:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365262.565692:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2361:x1874188003508480:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 209us (593us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365262.565699:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00010000:00010000:2.0:1787365262.565728:0:5834:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4760a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.565737:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4760a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.565756:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb47611 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.565774:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb47611 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.565782:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb47611 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365262.566898:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787365262.566912:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4760a lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.566920:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4760a lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.566926:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4760a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.566932:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780031a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365262.566935:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4760a lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.566942:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4760a lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.566954:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2789e48c00) 00010000:00010000:2.0:1787365262.566956:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365262.566960:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4760a lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.566965:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb4760a lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787365262.566993:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000002d9f4ca0 reply state 000000003d9159f3 transno 4294967416 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb47611 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365262.567001:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787365262.567060:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:11342:x1874188003508352:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 10323us (10500us total) trans 4294967416 rc 0/0 00000100:00100000:2.0:1787365262.567079:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 140 00000100:00080000:3.0:1787365262.567326:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787365262.570182:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb47611 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.570195:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb47611 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.570202:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb47611 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.570208:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365262.570212:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb47611 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.570218:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb47611 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.570233:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9f27988df200) 00010000:00010000:2.0:1787365262.570236:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365262.570240:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb47611 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.570247:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb47611 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365262.667825:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365262.668772:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003508608 00000100:00100000:2.0:1787365262.668783:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003508608 00000100:00100000:2.0:1787365262.668839:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 141 00000100:00100000:2.0:1787365262.668849:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:11350:x1874188003508608:12345-192.168.203.13@tcp:101:lctl.0 00010000:00010000:2.0:1787365262.668873:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365262.668895:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb47618 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989891ee expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.668959:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb4761f lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.668973:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb4761f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.668986:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb4761f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365262.669045:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:2.0:1787365262.669049:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365262.669086:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb4761f lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.669109:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb47618 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891ee expref: 15 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.669124:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb4761f lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891ee expref: 14 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.669132:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f27988dfc00) 00010000:00010000:2.0:1787365262.669145:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787365262.669149:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb709600, rc 0) 00000100:00100000:2.0:1787365262.669215:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c47800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:11350:x1874188003508608:12345-192.168.203.13@tcp:101:lctl.0 Request processed in 367us (1399us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365262.669222:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 141 00010000:00010000:1.0:1787365262.707669:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365262.754918:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365262.754971:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003508736 00000100:00100000:3.0:1787365262.754995:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003508736 00000100:00100000:3.0:1787365262.755059:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 142 00000100:00100000:3.0:1787365262.755078:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:11356:x1874188003508736:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1787365262.755097:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365262.755117:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb47626 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989891f5 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755191:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4762d lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755205:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4762d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755217:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4762d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755230:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47634 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755237:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47634 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755243:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47634 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755352:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45400/0x872d29295eb4763b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755360:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45400/0x872d29295eb4763b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755366:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45400/0x872d29295eb4763b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365262.755404:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:3.0:1787365262.755407:0:6704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787365262.755428:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45400/0x872d29295eb4763b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755439:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4762d lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755446:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4762d lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755452:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4762d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755457:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365262.755461:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4762d lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755469:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4762d lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755480:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f27988dfc00) 00010000:00010000:3.0:1787365262.755483:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365262.755488:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4762d lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755494:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4762d lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755506:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47634 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755521:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47634 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755527:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47634 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755532:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365262.755535:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47634 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755540:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47634 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755548:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x94c4507b (ffff9f2789e48100) 00010000:00010000:3.0:1787365262.755550:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365262.755713:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47634 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755723:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47634 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x94c4507b bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755752:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb47626 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891f5 expref: 16 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755765:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45400/0x872d29295eb4763b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891f5 expref: 15 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.755773:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:3.0:1787365262.755775:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787365262.755783:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45400, rc 0) 00000100:00100000:3.0:1787365262.755919:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+15:11356:x1874188003508736:12345-192.168.203.13@tcp:101:bash.0 Request processed in 852us (1008us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365262.755927:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 142 00000100:00100000:3.0:1787365262.761594:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365262.761775:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003508992 00000100:00100000:2.0:1787365262.761784:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003508992 00000100:00100000:2.0:1787365262.761852:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 143 00000100:00100000:2.0:1787365262.761862:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+15:11356:x1874188003508992:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1787365262.761883:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365262.761904:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb47642 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989891fc expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.762040:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47649 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.762055:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47649 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.762077:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47649 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.762118:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47650 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.762126:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47650 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.762132:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47650 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787365262.762910:0:5835:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x4:0x0], index 0: 0 00010000:00010000:2.0:1787365262.763091:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47657 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.763102:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.763111:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47657 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.763146:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47649 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.763154:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47649 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.763161:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47649 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.763168:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365262.763172:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47649 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.763180:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47649 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.763193:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:2.0:1787365262.763196:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365262.763201:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47649 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.763218:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47649 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787365262.763231:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000424d40b9 reply state 000000005219b493 transno 4294967417 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47650 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365262.763239:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:2.0:1787365262.763269:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb47642 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891fc expref: 18 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.763919:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47657 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891fc expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365262.763929:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f27988df900) 00010000:00010000:2.0:1787365262.763932:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787365262.763935:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb708a00, rc 0) 00000100:00100000:2.0:1787365262.764064:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c44380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:11356:x1874188003508992:12345-192.168.203.13@tcp:101:bash.0 Request processed in 2203us (2480us total) trans 4294967417 rc 0/0 00000100:00100000:2.0:1787365262.764081:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 143 00010000:00010000:1.0:1787365262.771167:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47650 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365262.771184:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47650 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365262.771193:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47650 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365262.771218:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365262.771222:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47650 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365262.771230:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47650 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365262.771245:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f27988df200) 00010000:00010000:1.0:1787365262.771248:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365262.771254:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47650 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365262.771260:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47650 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365262.783963:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365262.784080:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003509120 00000100:00100000:1.0:1787365262.784089:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003509120 00000100:00100000:1.0:1787365262.784166:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:1.0:1787365262.784176:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2361:x1874188003509120:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1787365262.784194:0:10260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365262.784215:0:10260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002321b5d0/0x872d29295eb47665 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989203 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787365262.784244:0:10260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787365262.784264:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=379s v=(0 0) 00010000:00010000:1.0:1787365262.784269:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365262.784290:0:10260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002321b5d0/0x872d29295eb47665 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989203 expref: 6 pid: 10260 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365262.784327:0:10260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000002321b5d0/0x872d29295eb47665 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989203 expref: 6 pid: 10260 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365262.784342:0:10260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115800, rc 0) 00000100:00100000:1.0:1787365262.784406:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c45180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2361:x1874188003509120:12345-192.168.203.13@tcp:101:bash.0 Request processed in 231us (452us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365262.784413:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00080000:3.0:1787365262.784954:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787365262.788061:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365262.788180:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003509248 00000100:00100000:1.0:1787365262.788189:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003509248 00000100:00100000:1.0:1787365262.788249:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:1.0:1787365262.788259:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:11356:x1874188003509248:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1787365262.788276:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365262.788422:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044b559c6/0x872d29295eb4766c lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898920a expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365262.788456:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000002321b5d0/0x872d29295eb47665 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989203 expref: 7 pid: 10260 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365262.788464:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365262.788468:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365262.788473:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044b559c6/0x872d29295eb4766c lrc: 4/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898920a expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365262.788503:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000002321b5d0/0x872d29295eb47665 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989203 expref: 7 pid: 10260 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365262.788523:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000002321b5d0/0x872d29295eb47665 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989203 expref: 7 pid: 10260 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365262.788536:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1874188024489472:192.168.203.13@tcp:104: 00000100:00100000:1.0:1787365262.788818:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bcfb90c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365262.803511:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0000_UUID:6681:1874188024489472:192.168.203.13@tcp:104: 00010000:00010000:1.0:1787365262.803546:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 0000000044b559c6/0x872d29295eb4766c lrc: 3/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898920a expref: 7 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365262.803579:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798114000, rc 0) 00000100:00100000:1.0:1787365262.803663:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:11356:x1874188003509248:12345-192.168.203.13@tcp:101:bash.0 Request processed in 15405us (15613us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365262.803672:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:3.0:1787365262.809731:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365262.809890:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003509376 00000100:00100000:0.0:1787365262.809899:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003509376 00010000:00010000:0.0:1787365262.809941:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000002321b5d0/0x872d29295eb47665 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989203 expref: 7 pid: 10260 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365262.809988:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:0.0:1787365262.809998:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2361:x1874188003509376:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787365262.810013:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365262.810035:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000002321b5d0/0x872d29295eb47665 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989203 expref: 7 pid: 10260 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.810049:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000002321b5d0/0x872d29295eb47665 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989203 expref: 7 pid: 10260 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.810082:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002321b5d0/0x872d29295eb47665 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989203 expref: 7 pid: 10260 timeout: 479 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.810099:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365262.810103:0:5818:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365262.810112:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 0000000044b559c6/0x872d29295eb4766c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898920a expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.810122:0:5818:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044b559c6/0x872d29295eb4766c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898920a expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365262.810160:0:5818:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 0000000044b559c6/0x872d29295eb4766c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898920a expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365262.810188:0:5818:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb843100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1874188024489600:192.168.203.13@tcp:105: 00000100:00100000:0.0:1787365262.810270:0:5818:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2686c77180 going to sleep for 11 seconds 00000100:00100000:3.0:1787365262.814701:0:5818:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb843100 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_000:lustre-OST0000_UUID:5818:1874188024489600:192.168.203.13@tcp:105: 00010000:00010000:3.0:1787365262.814728:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365262.814798:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c44a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2361:x1874188003509376:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 4800us (5076us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365262.814809:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:3.0:1787365262.819131:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365262.821567:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003509632 00000100:00100000:1.0:1787365262.821582:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003509632 00000100:00100000:1.0:1787365262.821688:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:1.0:1787365262.821698:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+17:11356:x1874188003509632:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:1.0:1787365262.822037:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:11356:x1874188003509632:12345-192.168.203.13@tcp:35:bash.0 Request processed in 340us (2914us total) trans 4294967418 rc 0/0 00000100:00100000:1.0:1787365262.822044:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:2.0:1787365262.963859:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365262.963989:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003509888 00000100:00100000:3.0:1787365262.963999:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003509888 00000100:00100000:3.0:1787365262.964060:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 144 00000100:00100000:3.0:1787365262.964081:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:11366:x1874188003509888:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1787365262.964105:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365262.964126:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb47673 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989211 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365262.964249:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787365262.964364:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb47673 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989211 expref: 20 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.964377:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f27988dfc00) 00010000:00010000:3.0:1787365262.964393:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787365262.964399:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb47673 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989211 expref: 20 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365262.964412:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45000, rc 0) 00000100:00100000:3.0:1787365262.964476:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+19:11366:x1874188003509888:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 408us (627us total) trans 4294967419 rc 301/301 00000100:00100000:3.0:1787365262.964483:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 144 00000100:00100000:3.0:1787365262.970286:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365262.970497:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003510144 00000100:00100000:0.0:1787365262.970506:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003510144 00000100:00100000:0.0:1787365262.970563:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:0.0:1787365262.970574:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+19:11366:x1874188003510144:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1787365262.970855:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+20:11366:x1874188003510144:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 282us (578us total) trans 4294967420 rc 0/0 00000100:00100000:0.0:1787365262.970863:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:0.0:1787365263.057209:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365263.057271:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003510272 00000100:00100000:2.0:1787365263.057280:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003510272 00000100:00100000:2.0:1787365263.057352:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00100000:2.0:1787365263.057363:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+20:11372:x1874188003510272:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1787365263.057387:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365263.057406:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb47681 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989218 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.057487:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb47688 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.057500:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb47688 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.057513:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb47688 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365263.057574:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:2.0:1787365263.057579:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365263.057601:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb47688 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.057662:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb47681 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989218 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.057679:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb47688 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989218 expref: 21 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.057688:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:2.0:1787365263.057691:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787365263.057694:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb708800, rc 0) 00000100:00100000:2.0:1787365263.057763:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb842680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:11372:x1874188003510272:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 401us (563us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365263.057770:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 145 00000100:00100000:2.0:1787365263.064208:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365263.064294:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003510528 00000100:00100000:3.0:1787365263.064304:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003510528 00000100:00100000:3.0:1787365263.064375:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 146 00000100:00100000:3.0:1787365263.064385:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:11372:x1874188003510528:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1787365263.064406:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365263.064427:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb4768f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898921f expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365263.064521:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47696 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365263.064534:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365263.064546:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47696 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365263.064557:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:3.0:1787365263.064727:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb4768f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898921f expref: 24 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365263.064762:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47696 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898921f expref: 23 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365263.064771:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f27988df900) 00010000:00010000:3.0:1787365263.064774:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787365263.064777:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45800, rc 0) 00000100:00100000:3.0:1787365263.064835:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+23:11372:x1874188003510528:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 452us (637us total) trans 4294967421 rc 0/0 00000100:00100000:3.0:1787365263.064842:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 146 00000100:00100000:3.0:1787365263.070500:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365263.070599:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003510784 00000100:00100000:2.0:1787365263.070620:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003510784 00000100:00100000:2.0:1787365263.070727:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 147 00000100:00100000:2.0:1787365263.070738:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+23:11372:x1874188003510784:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1787365263.070762:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365263.070783:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb476a4 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989226 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.070886:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb476ab lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.070901:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb476ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.070913:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb476ab lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365263.070925:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787365263.071042:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb476a4 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989226 expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.071061:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb476ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989226 expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.071082:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f27988df900) 00010000:00010000:2.0:1787365263.071085:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787365263.071088:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb708000, rc 0) 00000100:00100000:2.0:1787365263.071146:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c46d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+25:11372:x1874188003510784:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 410us (655us total) trans 4294967422 rc 0/0 00000100:00100000:2.0:1787365263.071154:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 147 00000100:00100000:0.0:1787365263.078390:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365263.078495:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003510912 00000100:00100000:1.0:1787365263.078505:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003510912 00000100:00100000:1.0:1787365263.078565:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:1.0:1787365263.078576:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2361:x1874188003510912:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:1.0:1787365263.078663:0:10260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000814f3401/0x872d29295eb476b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.078685:0:10260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 0000000044b559c6/0x872d29295eb4766c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898920a expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.078708:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x4:0x0].0x0 since=1s v=(0 0) 00010000:00010000:1.0:1787365263.078713:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787365263.078718:0:10260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000814f3401/0x872d29295eb476b9 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.078753:0:10260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 0000000044b559c6/0x872d29295eb4766c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898920a expref: 6 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.078767:0:10260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 0000000044b559c6/0x872d29295eb4766c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898920a expref: 6 pid: 6681 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365263.078782:0:10260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10260:1874188024489728:192.168.203.13@tcp:104: 00000100:00100000:1.0:1787365263.079059:0:10260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bcfb90c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365263.082502:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365263.082966:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003511040 00000100:00100000:2.0:1787365263.082976:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003511040 00000100:00100000:2.0:1787365263.083045:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:2.0:1787365263.083057:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+25:2360:x1874188003511040:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787365263.083084:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365263.083111:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47696 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898921f expref: 25 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.083133:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f27988df900) 00010000:00010000:2.0:1787365263.083138:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365263.083196:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c45880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+24:2360:x1874188003511040:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 142us (703us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365263.083204:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:2.0:1787365263.083817:0:10260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c5f80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10260:1874188024489728:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365263.083843:0:10260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000814f3401/0x872d29295eb476b9 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365263.085206:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365263.085279:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003511168 00000100:00100000:1.0:1787365263.085287:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003511168 00002000:00100000:1.0:1787365263.085345:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9f27b6c45f80 x1874188003511168/t0(0) o4->8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp:169/0 lens 504/0 e 0 to 0 dl 1787365274 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787365263.085356:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f27b6c45f80 with x1874188003511168 ext(0->12) 00010000:00010000:1.0:1787365263.085366:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000044b559c6/0x872d29295eb4766c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898920a expref: 7 pid: 6681 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.085400:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000044b559c6/0x872d29295eb4766c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898920a expref: 7 pid: 6681 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787365263.085408:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9f27b6c45f80 00000100:00100000:1.0:1787365263.085440:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:1.0:1787365263.085450:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2362:x1874188003511168:12345-192.168.203.13@tcp:4:lfs.0 00000100:00100000:1.0:1787365263.086287:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c45f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:2362:x1874188003511168:12345-192.168.203.13@tcp:4:lfs.0 Request processed in 834us (1082us total) trans 4294967305 rc 0/0 00000100:00100000:1.0:1787365263.086297:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00002000:00100000:1.0:1787365263.086307:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_002: refresh rw locks for [0x240000400:0x4:0x0] (0->12) req@ffff9f27b6c45f80 x1874188003511168/t4294967305(0) o4->8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp:169/0 lens 504/448 e 0 to 0 dl 1787365274 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787365263.086316:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f27b6c45f80 with x1874188003511168 ext(0->12) 00010000:00010000:1.0:1787365263.086325:0:6688:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 0000000044b559c6/0x872d29295eb4766c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898920a expref: 9 pid: 6681 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.086340:0:6688:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 0000000044b559c6/0x872d29295eb4766c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898920a expref: 9 pid: 6681 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787365263.086348:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9f27b6c45f80 00000100:00100000:3.0:1787365263.089883:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365263.089987:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003511296 00000100:00100000:2.0:1787365263.089996:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003511296 00010000:00010000:2.0:1787365263.090036:0:8434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 0000000044b559c6/0x872d29295eb4766c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898920a expref: 9 pid: 6681 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365263.090088:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:2.0:1787365263.090099:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb55b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:2359:x1874188003511296:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787365263.090115:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:2.0:1787365263.090134:0:8434:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787365263.090144:0:8434:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb mtime from disk: 0 -> 1787365262 00002000:00010000:2.0:1787365263.090146:0:8434:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb atime from disk: 0 -> 1787365262 00002000:00010000:2.0:1787365263.090148:0:8434:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x4:0x0] updating lvb ctime from disk: 0 -> 1787365262 00010000:00010000:2.0:1787365263.090155:0:8434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 0000000044b559c6/0x872d29295eb4766c lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898920a expref: 9 pid: 6681 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.090169:0:8434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 0000000044b559c6/0x872d29295eb4766c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898920a expref: 9 pid: 6681 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.090194:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044b559c6/0x872d29295eb4766c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898920a expref: 9 pid: 6681 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.090212:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787365263.090217:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787365263.090222:0:8434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000814f3401/0x872d29295eb476b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.090232:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000814f3401/0x872d29295eb476b9 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.090267:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365263.090315:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb55b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2359:x1874188003511296:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 217us (535us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365263.090323:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00010000:00010000:1.0:1787365263.090955:0:10260:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000814f3401/0x872d29295eb476b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.090967:0:10260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000814f3401/0x872d29295eb476b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.091006:0:10260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000814f3401/0x872d29295eb476b9 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.091015:0:10260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000814f3401/0x872d29295eb476b9 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.091023:0:10260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000814f3401/0x872d29295eb476b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.091029:0:10260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114a00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365263.091033:0:10260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000814f3401/0x872d29295eb476b9 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.091041:0:10260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000814f3401/0x872d29295eb476b9 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.091054:0:10260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000814f3401/0x872d29295eb476b9 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.091062:0:10260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000814f3401/0x872d29295eb476b9 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365263.091129:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2361:x1874188003510912:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 12554us (12747us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365263.091138:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:3.0:1787365263.094729:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365263.094925:0:11946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003511552 00000100:00100000:0.0:1787365263.094936:0:11946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003511552 00000100:00100000:0.0:1787365263.094997:0:11946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:0.0:1787365263.095007:0:11946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278ac6f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+24:11372:x1874188003511552:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:0.0:1787365263.095082:0:11946:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xb:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb476ab lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989226 expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787365263.095352:0:11946:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967423 00000001:00080000:0.0:1787365263.095396:0:11946:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967424 00000001:00080000:0.0:1787365263.096166:0:11946:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967425 00010000:00010000:0.0:1787365263.096223:0:11946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.096239:0:11946:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47657 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891fc expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.096254:0:11946:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476c0 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.096287:0:11946:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47657 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891fc expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.096301:0:11946:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47657 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891fc expref: 28 pid: 5835 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365263.096314:0:11946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb843b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11946:1874188024489856:192.168.203.13@tcp:104: 00000100:00100000:0.0:1787365263.096482:0:11946:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2686c779c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365263.100363:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365263.101276:0:11946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb843b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000_UUID:11946:1874188024489856:192.168.203.13@tcp:104: 00010000:00010000:0.0:1787365263.101306:0:11946:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365263.101489:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003511680 00000100:00100000:1.0:1787365263.101497:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003511680 00010000:00010000:1.0:1787365263.101534:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47657 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891fc expref: 29 pid: 5835 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365263.101609:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:1.0:1787365263.101619:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb55b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+29:2362:x1874188003511680:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365263.101646:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365263.101653:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47657 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891fc expref: 29 pid: 5835 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.101666:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47657 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891fc expref: 29 pid: 5835 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.101688:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47657 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891fc expref: 29 pid: 5835 timeout: 480 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.101712:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f27988df900) 00010000:00010000:1.0:1787365263.101717:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476c0 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.101726:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.101733:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476c0 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.101760:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365263.101822:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb55b480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+28:2362:x1874188003511680:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 205us (1467us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365263.101842:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00010000:00010000:0.0:1787365263.102597:0:11946:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.102608:0:11946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787365263.102767:0:11946:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967426 00000001:00080000:0.0:1787365263.102972:0:11946:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967427 00000100:00100000:0.0:1787365263.103100:0:11946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb843b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11946:1874188024489984:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787365263.103170:0:11946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365263.103201:0:11946:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2686c77900 going to sleep for 11 seconds 00000100:00100000:3.0:1787365263.103275:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024489984 00000100:00100000:3.0:1787365263.103283:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024489984 00000100:00100000:3.0:1787365263.103345:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787365263.103353:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11946:x1874188024489984:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787365263.103425:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11946:x1874188024489984:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 72us (254us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365263.103431:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00080000:0.0:1787365263.103904:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787365263.103951:0:11946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb843b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11946:1874188024489984:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1787365263.105102:0:11946:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967428 00000100:00100000:0.0:1787365263.105185:0:11946:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb843b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11946:1874188024490112:0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:0.0:1787365263.105236:0:11946:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365263.105259:0:11946:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2686c779c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365263.105347:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024490112 00000100:00100000:3.0:1787365263.105354:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024490112 00000100:00100000:3.0:1787365263.105400:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:3.0:1787365263.105409:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:11946:x1874188024490112:12345-0@lo:1000:mdt_rdpg00_002.0 00000100:00100000:3.0:1787365263.105583:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:11946:x1874188024490112:12345-0@lo:1000:mdt_rdpg00_002.0 Request processed in 175us (346us total) trans 4294967306 rc 0/0 00000100:00100000:3.0:1787365263.105592:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787365263.105943:0:11946:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb843b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_002:lustre-MDT0000-mdtlov_UUID:11946:1874188024490112:0@lo:1000:mdt_rdpg00_002.0 00000001:00080000:0.0:1787365263.105996:0:11946:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967429 00010000:00010000:0.0:1787365263.106035:0:11946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476c0 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.106044:0:11946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476c0 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.106050:0:11946:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.106056:0:11946:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365263.106060:0:11946:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476c0 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.106077:0:11946:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476c0 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.106092:0:11946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f27988df900) 00010000:00010000:0.0:1787365263.106095:0:11946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:0.0:1787365263.106099:0:11946:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476c0 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.106104:0:11946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476c0 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787365263.106287:0:11946:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xc:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:0.0:1787365263.106416:0:11946:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].4, 64 off8448 00000004:00080000:0.0:1787365263.106427:0:11946:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 380270801147ns, next at 381270799304ns, rc = 0 00000001:00080000:0.0:1787365263.106434:0:11946:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967430 00010000:00010000:0.0:1787365263.106464:0:11946:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f27988df900) 00010000:00010000:0.0:1787365263.106467:0:11946:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:0.0:1787365263.106474:0:11946:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb476ab lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989226 expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365263.106568:0:11946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278ac6f050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+31:11372:x1874188003511552:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 11562us (11848us total) trans 4294967431 rc 0/0 00000100:00100000:0.0:1787365263.106577:0:11946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000020:00080000:0.0:1787365263.106581:0:11946:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:3.0:1787365263.109975:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365263.111920:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003511808 00000100:00100000:0.0:1787365263.111934:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003511808 00000100:00100000:0.0:1787365263.112000:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 148 00000100:00100000:0.0:1787365263.112010:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+31:11372:x1874188003511808:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1787365263.112033:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365263.112057:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb476c7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898922d expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.112131:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb476c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898922d expref: 32 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.112146:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb476c7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898922d expref: 32 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.112186:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:0.0:1787365263.112190:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787365263.112193:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780031c00, rc 0) 00000100:00100000:0.0:1787365263.112252:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb559880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+32:11372:x1874188003511808:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 243us (2286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365263.112260:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 148 00000100:00100000:3.0:1787365263.116584:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365263.116761:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003512064 00000100:00100000:1.0:1787365263.116771:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003512064 00000100:00100000:1.0:1787365263.116834:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:1.0:1787365263.116844:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+32:11372:x1874188003512064:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1787365263.117086:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+33:11372:x1874188003512064:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 243us (513us total) trans 4294967432 rc 0/0 00000100:00100000:1.0:1787365263.117094:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:3.0:1787365263.242218:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365263.242452:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003512320 00000100:00100000:2.0:1787365263.242461:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003512320 00000100:00100000:2.0:1787365263.242520:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 149 00000100:00100000:2.0:1787365263.242530:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+33:11382:x1874188003512320:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1787365263.242568:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365263.242590:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb476ce lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989234 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365263.242740:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:2.0:1787365263.242869:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb476ce lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989234 expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.242884:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f27988dfc00) 00010000:00010000:2.0:1787365263.242887:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787365263.242892:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb476ce lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989234 expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.242906:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb709c00, rc 0) 00000100:00100000:2.0:1787365263.242965:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+34:11382:x1874188003512320:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 437us (759us total) trans 4294967433 rc 301/301 00000100:00100000:2.0:1787365263.242973:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 149 00000100:00100000:2.0:1787365263.265515:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365263.265673:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003512448 00000100:00100000:0.0:1787365263.265684:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003512448 00000100:00100000:0.0:1787365263.265744:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00100000:0.0:1787365263.265754:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+34:11382:x1874188003512448:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:0.0:1787365263.265842:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476dc lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.265860:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.265871:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.265886:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb476e3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.265893:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb476e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.265900:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb476e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.265998:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb476ea lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.266021:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb476ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.266029:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb476ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787365263.266081:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb476ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.266094:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476dc lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.266101:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476dc lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.266108:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.266114:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365263.266119:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476dc lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.266127:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476dc lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.266138:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:0.0:1787365263.266141:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365263.266145:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476dc lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.266151:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb476dc lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.266173:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb476e3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.266180:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb476e3 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.266186:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb476e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.266191:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780031a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365263.266195:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb476e3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.266200:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb476e3 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.266207:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f278a0ad700) 00010000:00010000:0.0:1787365263.266210:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365263.266213:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb476e3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.266219:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb476e3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.266234:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb476ea lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.266240:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb476ea lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.266246:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb476ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.266257:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2045a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365263.266260:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb476ea lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.266266:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb476ea lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.266286:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:0.0:1787365263.266289:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365263.266292:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb476ea lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.266298:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb476ea lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365263.266371:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+34:11382:x1874188003512448:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 618us (864us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365263.266380:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 150 00000100:00100000:3.0:1787365263.275725:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365263.275838:0:11946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003512704 00000100:00100000:0.0:1787365263.275848:0:11946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003512704 00000100:00100000:0.0:1787365263.275907:0:11946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:0.0:1787365263.275917:0:11946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+34:11382:x1874188003512704:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1787365263.276188:0:11946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+35:11382:x1874188003512704:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 271us (472us total) trans 4294967434 rc 0/0 00000100:00100000:0.0:1787365263.276195:0:11946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:1.0:1787365263.337923:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365263.338040:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003512960 00000100:00100000:2.0:1787365263.338050:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003512960 00000100:00100000:2.0:1787365263.338121:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00100000:2.0:1787365263.338131:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+35:11385:x1874188003512960:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1787365263.338154:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365263.338175:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb476f1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898923b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.338253:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb476f8 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.338281:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb476f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.338293:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb476f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.338310:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb476ff lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.338316:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb476ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.338322:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb476ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.338514:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb47706 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.338523:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb47706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.338531:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb47706 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365263.338541:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787365263.338676:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb476f8 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.338685:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb476f8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.338693:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb476f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.338707:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365263.338711:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb476f8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.338719:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb476f8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.338733:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:2.0:1787365263.338736:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365263.338741:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb476f8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.338747:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb476f8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.338761:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb476ff lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.338767:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb476ff lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.338773:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb476ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.338778:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365263.338781:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb476ff lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.338787:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb476ff lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.338806:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f27988dfa00) 00010000:00010000:2.0:1787365263.338809:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365263.338812:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb476ff lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.338818:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb476ff lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.339837:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb476f1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898923b expref: 38 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.339872:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb47706 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898923b expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.339881:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:2.0:1787365263.339884:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787365263.339887:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb708000, rc 0) 00000100:00100000:2.0:1787365263.339959:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+37:11385:x1874188003512960:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1830us (2115us total) trans 4294967435 rc 0/0 00000100:00100000:2.0:1787365263.339968:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 151 00000100:00100000:2.0:1787365263.343145:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365263.343357:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003513088 00000100:00100000:0.0:1787365263.343368:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003513088 00000100:00100000:0.0:1787365263.343429:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 152 00000100:00100000:0.0:1787365263.343456:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+37:11385:x1874188003513088:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:0.0:1787365263.343528:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47714 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.343544:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.343558:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.343586:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47714 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.343594:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47714 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.343601:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.343607:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2045a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365263.343611:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47714 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.343619:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47714 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.343670:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:0.0:1787365263.343673:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787365263.343678:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47714 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.343685:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb47714 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365263.343770:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae87100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+37:11385:x1874188003513088:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 317us (636us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365263.343778:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 152 00000100:00100000:3.0:1787365263.346379:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365263.346518:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003513344 00000100:00100000:0.0:1787365263.346528:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003513344 00000100:00100000:0.0:1787365263.346587:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:0.0:1787365263.346598:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+37:11385:x1874188003513344:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1787365263.347036:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+38:11385:x1874188003513344:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 438us (664us total) trans 4294967436 rc 0/0 00000100:00100000:0.0:1787365263.347045:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:2.0:1787365263.649783:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365263.650087:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003513600 00000100:00100000:1.0:1787365263.650097:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003513600 00000100:00100000:1.0:1787365263.650159:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 153 00000100:00100000:1.0:1787365263.650169:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+38:11416:x1874188003513600:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:1.0:1787365263.650203:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365263.650225:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb4771b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989242 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.650334:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb47722 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.650349:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb47722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.650360:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb47722 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787365263.650372:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:0.0:1787365263.654398:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb4771b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989242 expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.654430:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb47722 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989242 expref: 40 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.654440:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:0.0:1787365263.654443:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787365263.654447:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115c00, rc 0) 00000100:00100000:0.0:1787365263.654714:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae85f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+40:11416:x1874188003513600:12345-192.168.203.13@tcp:101:cat.0 Request processed in 4545us (4937us total) trans 4294967437 rc 0/0 00000100:00100000:0.0:1787365263.654725:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 153 00000100:00100000:2.0:1787365263.667207:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365263.673129:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003513728 00000100:00100000:1.0:1787365263.673145:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003513728 00000100:00100000:1.0:1787365263.673246:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:1.0:1787365263.673257:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+40:2362:x1874188003513728:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365263.673272:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365263.673298:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb47722 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989242 expref: 40 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365263.673317:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:1.0:1787365263.673331:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365263.673711:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365263.673807:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae87b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+39:2362:x1874188003513728:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 551us (6616us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365263.673816:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:0.0:1787365263.674251:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003513984 00000100:00100000:0.0:1787365263.674259:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003513984 00000100:00100000:0.0:1787365263.674314:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:0.0:1787365263.674323:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+39:11416:x1874188003513984:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:0.0:1787365263.674564:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb558000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+40:11416:x1874188003513984:12345-192.168.203.13@tcp:35:cat.0 Request processed in 242us (854us total) trans 4294967438 rc 0/0 00000100:00100000:0.0:1787365263.674572:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00010000:00010000:1.0:1787365263.731493:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365263.738716:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365263.738763:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365263.738793:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365263.738866:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003514240 00000100:00100000:1.0:1787365263.738875:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003514240 00000100:00100000:1.0:1787365263.738945:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:1.0:1787365263.738955:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2359:x1874188003514240:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365263.739023:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae86a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2359:x1874188003514240:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 69us (316us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365263.739030:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:0.0:1787365263.739119:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003514368 00000100:00100000:0.0:1787365263.739124:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003514368 00000100:00100000:0.0:1787365263.739164:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:0.0:1787365263.739172:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2359:x1874188003514368:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365263.739202:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae87480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2359:x1874188003514368:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 32us (408us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365263.739208:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:3.0:1787365263.739797:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003514112 00000100:00100000:3.0:1787365263.739803:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003514112 00000100:00100000:3.0:1787365263.739843:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 298 00000100:00100000:3.0:1787365263.739852:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2359:x1874188003514112:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365263.739884:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e19050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2359:x1874188003514112:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 34us (1121us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365263.739891:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 298 00000100:00080000:2.0:1787365263.740158:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787365263.858165:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365263.858285:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003514624 00000100:00100000:2.0:1787365263.858294:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003514624 00000100:00100000:2.0:1787365263.858361:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 154 00000100:00100000:2.0:1787365263.858371:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+40:11422:x1874188003514624:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:2.0:1787365263.858397:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365263.858400:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787365263.858427:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb47688 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989218 expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.858445:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:2.0:1787365263.858450:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787365263.858462:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb47730 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989249 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.858554:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47737 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.858567:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb47706 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898923b expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.858576:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47737 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.858606:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb47706 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898923b expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.858619:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb47706 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898923b expref: 40 pid: 5833 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365263.858727:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bae84000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874188024490240:192.168.203.13@tcp:104: 00000100:00100000:2.0:1787365263.858828:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473ff00 going to sleep for 11 seconds 00000100:00100000:3.0:1787365263.862091:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365263.862191:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003514752 00000100:00100000:0.0:1787365263.862201:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003514752 00010000:00010000:0.0:1787365263.862240:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb47706 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898923b expref: 41 pid: 5833 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365263.862287:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:0.0:1787365263.862297:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27882ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+41:2362:x1874188003514752:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787365263.862311:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365263.862317:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb47706 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898923b expref: 41 pid: 5833 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.862329:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb47706 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898923b expref: 41 pid: 5833 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.862363:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:0.0:1787365263.862369:0:8435:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47737 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.862391:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47737 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.862398:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47737 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.862418:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365263.862466:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27882ba050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+41:2362:x1874188003514752:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 169us (384us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365263.862474:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00010000:00010000:2.0:1787365263.864302:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb47706 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898923b expref: 40 pid: 5833 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365263.864323:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bae84000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874188024490240:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365263.864357:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47737 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.864367:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47737 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.864373:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47737 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365263.864392:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 13 00010000:00010000:2.0:1787365263.864547:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb47730 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989249 expref: 41 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.864562:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47737 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989249 expref: 40 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.864572:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:2.0:1787365263.864575:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787365263.864579:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb708a00, rc 0) 00000100:00100000:2.0:1787365263.864682:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb559f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+40:11422:x1874188003514624:12345-192.168.203.13@tcp:101:dd.0 Request processed in 6311us (6524us total) trans 4294967439 rc 0/0 00000100:00100000:2.0:1787365263.864707:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 154 00000100:00100000:3.0:1787365263.869248:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365263.872702:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003515008 00000100:00100000:0.0:1787365263.872717:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003515008 00000100:00100000:0.0:1787365263.872797:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 155 00000100:00100000:0.0:1787365263.872808:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb55aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+40:11422:x1874188003515008:12345-192.168.203.13@tcp:36:dd.0 00010000:00010000:0.0:1787365263.873056:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47745 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.873084:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47745 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365263.873096:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47745 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787365263.873144:0:6704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967440 00000004:00010000:0.0:1787365263.873168:0:6704:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000576eb1cf reply state 00000000bc62edeb transno 4294967441 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47745 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365263.873176:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787365263.873273:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb55aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+43:11422:x1874188003515008:12345-192.168.203.13@tcp:36:dd.0 Request processed in 466us (4034us total) trans 4294967441 rc 0/0 00000100:00100000:0.0:1787365263.873297:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 155 00000020:00080000:0.0:1787365263.873302:0:6704:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787365263.878689:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47745 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.878707:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47745 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.878715:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47745 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.878721:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2045800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365263.878727:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47745 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.878736:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47745 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.878754:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:2.0:1787365263.878757:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365263.878762:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47745 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365263.878768:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47745 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787365264.242857:0:6867:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 381407228450ns, next at 382407225950ns, rc = 0 00000100:00100000:1.0:1787365264.242995:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787365264.243017:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bae84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024490368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787365264.243106:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365264.243235:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024490368 00000100:00100000:3.0:1787365264.243243:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024490368 00000100:00100000:3.0:1787365264.243303:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:3.0:1787365264.243313:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874188024490368:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787365264.243333:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 1703936 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365264.243385:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c6a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874188024490368:12345-0@lo:13:osp-pre-0-0.0 Request processed in 73us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365264.243407:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787365264.243763:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bae84000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024490368:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787365264.264301:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365264.264444:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003515136 00000100:00100000:2.0:1787365264.264452:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003515136 00000100:00100000:2.0:1787365264.264535:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 156 00000100:00100000:2.0:1787365264.264560:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+42:11436:x1874188003515136:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:2.0:1787365264.264583:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365264.264604:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb4774c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989250 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.264701:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb47753 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.264716:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb47753 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.264728:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb47753 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.264743:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb4775a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.264749:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb4775a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.264755:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb4775a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.264844:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb47761 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.264855:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47737 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989249 expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.264862:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb47761 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.264901:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47737 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989249 expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.264912:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47737 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989249 expref: 43 pid: 5833 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365264.264925:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bae84000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874188024490496:192.168.203.13@tcp:104: 00000100:00100000:2.0:1787365264.265022:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473fb40 going to sleep for 11 seconds 00000100:00080000:0.0:1787365264.265095:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365264.268252:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365264.268374:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003515392 00000100:00100000:0.0:1787365264.268382:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003515392 00000100:00100000:0.0:1787365264.268442:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:0.0:1787365264.268452:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb55a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+44:5596:x1874188003515392:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:0.0:1787365264.268817:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb55a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+45:5596:x1874188003515392:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 365us (573us total) trans 4294967442 rc 0/0 00000100:00100000:0.0:1787365264.268825:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:2.0:1787365264.270734:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bae84000 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874188024490496:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365264.270763:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb47761 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365264.272718:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365264.272885:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003515520 00000100:00100000:1.0:1787365264.272895:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003515520 00010000:00010000:1.0:1787365264.272945:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47737 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989249 expref: 45 pid: 5833 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365264.273119:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:1.0:1787365264.273131:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb55b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+45:2362:x1874188003515520:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365264.273146:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365264.273153:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47737 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989249 expref: 45 pid: 5833 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365264.273168:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47737 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989249 expref: 45 pid: 5833 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365264.273189:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47737 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989249 expref: 45 pid: 5833 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365264.273206:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:1.0:1787365264.273212:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb47761 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365264.273221:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb47761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365264.273229:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb47761 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365264.273264:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365264.273325:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb55b800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+44:2362:x1874188003515520:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 196us (615us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365264.273332:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00010000:00010000:0.0:1787365264.274339:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb47761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.274351:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb47761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365264.274396:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787365264.274400:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787365264.274421:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb47761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.274434:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb47761 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.274444:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb47753 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.274450:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb47753 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.274471:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb47753 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.274477:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365264.274481:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb47753 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.274489:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb47753 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.274501:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:0.0:1787365264.274504:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365264.274509:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb47753 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.274515:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708000/0x872d29295eb47753 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.274527:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb4775a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.274533:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb4775a lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.274539:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb4775a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.274544:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365264.274547:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb4775a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.274563:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb4775a lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.274572:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f27988dfa00) 00010000:00010000:0.0:1787365264.274574:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365264.274577:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb4775a lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.274582:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb4775a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.274622:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb4774c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989250 expref: 44 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.275387:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb47761 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989250 expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.275395:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:0.0:1787365264.275397:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787365264.275400:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb709800, rc 0) 00000100:00100000:0.0:1787365264.275451:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+43:11436:x1874188003515136:12345-192.168.203.13@tcp:101:stat.0 Request processed in 10895us (11160us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365264.275460:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 156 00000100:00100000:3.0:1787365264.344573:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365264.345028:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003515776 00000100:00100000:0.0:1787365264.345038:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003515776 00000100:00100000:0.0:1787365264.345116:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 157 00000100:00100000:0.0:1787365264.345125:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb55a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+43:11442:x1874188003515776:12345-192.168.203.13@tcp:36:truncate.0 00010000:00010000:0.0:1787365264.345211:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365264.345238:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709800/0x872d29295eb47761 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989250 expref: 43 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.345256:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:0.0:1787365264.345260:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787365264.345477:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47768 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.345492:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.345502:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787365264.345556:0:6704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967443 00000004:00010000:0.0:1787365264.345578:0:6704:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000009b4c81fb reply state 00000000c12d7bb0 transno 4294967444 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365264.345586:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787365264.348893:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb55a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+45:11442:x1874188003515776:12345-192.168.203.13@tcp:36:truncate.0 Request processed in 3756us (4316us total) trans 4294967444 rc 0/0 00000100:00100000:0.0:1787365264.348905:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 157 00000020:00080000:0.0:1787365264.348913:0:6704:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787365264.354885:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47768 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.354900:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47768 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.354907:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47768 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.354927:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2045400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365264.354932:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47768 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.354940:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47768 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.354956:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:0.0:1787365264.354959:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365264.354964:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47768 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.354970:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47768 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365264.568406:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365264.568660:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003515904 00000100:00100000:2.0:1787365264.568671:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003515904 00000100:00100000:2.0:1787365264.568733:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 158 00000100:00100000:2.0:1787365264.568743:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb55bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+44:11456:x1874188003515904:12345-192.168.203.13@tcp:101:stat.0 00010000:00010000:2.0:1787365264.568767:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365264.568796:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb4776f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989257 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.568860:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47776 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.568873:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47776 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.568883:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47776 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.568911:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb4777d lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.568919:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb4777d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.568925:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb4777d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.569021:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47784 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.569030:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.569036:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365264.569081:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00000004:00200000:2.0:1787365264.569086:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365264.569108:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.569121:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47784 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.569129:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47776 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.569135:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47776 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.569152:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47776 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.569159:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365264.569163:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47776 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.569171:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47776 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.569183:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:2.0:1787365264.569186:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365264.569190:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47776 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.569196:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47776 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.569209:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb4777d lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.569216:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb4777d lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.569222:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb4777d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.569226:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365264.569228:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb4777d lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.569244:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb4777d lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.569252:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f27988df800) 00010000:00010000:2.0:1787365264.569254:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365264.569257:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb4777d lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.569263:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb4777d lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.569294:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb4776f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989257 expref: 46 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.569307:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47784 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989257 expref: 45 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.569314:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:2.0:1787365264.569316:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787365264.569318:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb708c00, rc 0) 00000100:00100000:2.0:1787365264.569377:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb55bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+45:11456:x1874188003515904:12345-192.168.203.13@tcp:101:stat.0 Request processed in 635us (981us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365264.569384:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 158 00000100:00100000:1.0:1787365264.728963:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365264.729266:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003516160 00000100:00100000:3.0:1787365264.729276:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003516160 00000100:00100000:3.0:1787365264.729401:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 159 00000100:00100000:3.0:1787365264.729421:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+45:11466:x1874188003516160:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1787365264.729442:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365264.729464:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4778b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898925e expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365264.729578:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:3.0:1787365264.729734:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4778b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898925e expref: 47 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365264.729749:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f27988dfc00) 00010000:00010000:3.0:1787365264.729752:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787365264.729757:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4778b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898925e expref: 47 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365264.729771:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44c00, rc 0) 00000100:00100000:3.0:1787365264.729846:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+46:11466:x1874188003516160:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 436us (892us total) trans 4294967445 rc 301/301 00000100:00100000:3.0:1787365264.729854:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 159 00000100:00100000:1.0:1787365264.739899:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365264.739997:0:11946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003516416 00000100:00100000:2.0:1787365264.740006:0:11946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003516416 00000100:00100000:2.0:1787365264.740069:0:11946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:2.0:1787365264.740078:0:11946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278ac6dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+46:11466:x1874188003516416:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1787365264.740338:0:11946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278ac6dc50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+47:11466:x1874188003516416:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 245us (431us total) trans 4294967446 rc 0/0 00000100:00100000:2.0:1787365264.740346:0:11946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00010000:00010000:1.0:1787365264.754867:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787365264.819281:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967305 is committed 00000001:00080000:0.0:1787365264.819301:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967306 is committed 00000100:00100000:1.0:1787365264.825972:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365264.826598:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003516672 00000100:00100000:2.0:1787365264.826609:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003516672 00000100:00100000:2.0:1787365264.826705:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 160 00000100:00100000:2.0:1787365264.826716:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+47:11472:x1874188003516672:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:2.0:1787365264.826739:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365264.826759:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb47799 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989265 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.826875:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb477a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.826889:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47784 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989257 expref: 48 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.826898:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb477a0 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.827065:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47784 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989257 expref: 48 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.827080:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47784 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989257 expref: 48 pid: 5833 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365264.827093:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bae84000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874188024490624:192.168.203.13@tcp:104: 00000100:00100000:2.0:1787365264.827216:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365264.834150:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365264.834405:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003516800 00000100:00100000:3.0:1787365264.834429:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003516800 00010000:00010000:3.0:1787365264.834472:0:8434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47784 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989257 expref: 49 pid: 5833 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365264.834514:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:3.0:1787365264.834524:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+49:2362:x1874188003516800:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365264.834538:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365264.834545:0:8434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47784 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989257 expref: 49 pid: 5833 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365264.834558:0:8434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47784 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989257 expref: 49 pid: 5833 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365264.834581:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:3.0:1787365264.834586:0:8434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb477a0 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365264.834595:0:8434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb477a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365264.834602:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb477a0 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365264.834620:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365264.834705:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b56300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+49:2362:x1874188003516800:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 182us (563us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365264.834713:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 65 00010000:00010000:2.0:1787365264.835557:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47784 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989257 expref: 48 pid: 5833 timeout: 481 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365264.835577:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bae84000 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874188024490624:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365264.835600:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb477a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.835609:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb477a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.835614:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb477a0 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365264.835678:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 1234567 00010000:00010000:2.0:1787365264.836084:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb47799 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989265 expref: 49 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.836102:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb477a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989265 expref: 48 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.836110:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:2.0:1787365264.836113:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:2.0:1787365264.836116:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb709a00, rc 0) 00000100:00100000:2.0:1787365264.836220:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+48:11472:x1874188003516672:12345-192.168.203.13@tcp:101:bash.0 Request processed in 9505us (10255us total) trans 4294967447 rc 0/0 00000100:00100000:2.0:1787365264.836228:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 160 00000100:00100000:1.0:1787365264.842562:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365264.842679:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003517056 00000100:00100000:0.0:1787365264.842689:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003517056 00000100:00100000:0.0:1787365264.842738:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 161 00000100:00100000:0.0:1787365264.842749:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+48:11472:x1874188003517056:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:0.0:1787365264.843002:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb477ae lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.843020:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb477ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.843034:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb477ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787365264.843118:0:6704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967448 00000004:00010000:0.0:1787365264.843145:0:6704:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c2205f11 reply state 00000000f8c362b3 transno 4294967449 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb477ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365264.843154:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787365264.843249:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b35880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+51:11472:x1874188003517056:12345-192.168.203.13@tcp:36:bash.0 Request processed in 500us (694us total) trans 4294967449 rc 0/0 00000100:00100000:0.0:1787365264.843257:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 161 00000020:00080000:0.0:1787365264.843261:0:6704:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:2.0:1787365264.850073:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb477ae lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.850105:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb477ae lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.850113:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb477ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.850119:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2045400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365264.850125:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb477ae lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.850133:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb477ae lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.850150:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:2.0:1787365264.850153:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365264.850158:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb477ae lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.850164:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb477ae lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365264.851476:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365264.851558:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003517184 00000100:00100000:0.0:1787365264.851568:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003517184 00000100:00100000:0.0:1787365264.851648:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 162 00000100:00100000:0.0:1787365264.851660:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+50:11472:x1874188003517184:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1787365264.851694:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365264.851714:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb477b5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898926c expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.851802:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb477bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.851817:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb477a0 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989265 expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.851825:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb477bc lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.851859:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb477a0 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989265 expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.851889:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb477a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989265 expref: 51 pid: 5833 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365264.851905:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6cb3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874188024490752:192.168.203.13@tcp:104: 00000100:00100000:0.0:1787365264.851996:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27a5b67540 going to sleep for 11 seconds 00000100:00100000:1.0:1787365264.855542:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365264.855660:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003517312 00000100:00100000:3.0:1787365264.855670:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003517312 00010000:00010000:3.0:1787365264.855732:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb477a0 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989265 expref: 52 pid: 5833 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365264.855764:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:3.0:1787365264.855773:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+52:2361:x1874188003517312:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365264.855801:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365264.855807:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb477a0 lrc: 5/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989265 expref: 52 pid: 5833 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365264.855820:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb477a0 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989265 expref: 52 pid: 5833 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365264.855843:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:3.0:1787365264.855848:0:8435:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb477bc lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x8 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365264.855858:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb477bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365264.855865:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb477bc lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 6 type: IBT flags: 0x50290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365264.855884:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365264.855947:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b35f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+52:2361:x1874188003517312:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 174us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365264.855955:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00010000:00010000:0.0:1787365264.856204:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb477a0 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989265 expref: 51 pid: 5833 timeout: 482 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365264.856221:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6cb3800 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874188024490752:192.168.203.13@tcp:104: 00010000:00010000:0.0:1787365264.856242:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb477bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.856251:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb477bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.856257:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb477bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365264.856304:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:0.0:1787365264.856309:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787365264.856329:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb477bc lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.856369:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb477b5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898926c expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.856386:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb477bc lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898926c expref: 50 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.856403:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:0.0:1787365264.856406:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787365264.856408:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27c2045a00, rc 0) 00000100:00100000:0.0:1787365264.856434:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b35180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+50:11472:x1874188003517184:12345-192.168.203.13@tcp:101:bash.0 Request processed in 4777us (4968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365264.856441:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 162 00000100:00100000:1.0:1787365264.862045:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365264.865944:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003517568 00000100:00100000:0.0:1787365264.865959:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003517568 00000100:00100000:0.0:1787365264.866030:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:0.0:1787365264.866042:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+50:11472:x1874188003517568:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:0.0:1787365264.866455:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+51:11472:x1874188003517568:12345-192.168.203.13@tcp:35:bash.0 Request processed in 415us (4419us total) trans 4294967450 rc 0/0 00000100:00100000:0.0:1787365264.866464:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:2.0:1787365264.964488:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365264.964591:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003517824 00000100:00100000:0.0:1787365264.964601:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003517824 00000100:00100000:0.0:1787365264.964691:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 163 00000100:00100000:0.0:1787365264.964702:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+51:11482:x1874188003517824:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1787365264.964736:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365264.964756:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb477c3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989273 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365264.964878:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00010000:00010000:0.0:1787365264.965008:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb477c3 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989273 expref: 53 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.965040:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f27988dfc00) 00010000:00010000:0.0:1787365264.965044:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787365264.965049:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb477c3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989273 expref: 53 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365264.965076:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27c2045800, rc 0) 00000100:00100000:0.0:1787365264.965127:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae84000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+52:11482:x1874188003517824:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 428us (647us total) trans 4294967451 rc 301/301 00000100:00100000:0.0:1787365264.965135:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 163 00000100:00100000:1.0:1787365264.968953:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365264.969209:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003517952 00000100:00100000:2.0:1787365264.969218:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003517952 00000100:00100000:2.0:1787365264.969275:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:2.0:1787365264.969285:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+52:11482:x1874188003517952:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:2.0:1787365264.971462:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb477d1 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.971486:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb477d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.971514:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb477d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.971531:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb477d8 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.971538:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb477d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.971544:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb477d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.971854:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb477df lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.971865:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb477df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.971872:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb477df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787365264.971918:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb477df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.972399:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb477d1 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.972405:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb477d1 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.972412:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb477d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.972430:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365264.972434:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb477d1 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.972442:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb477d1 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.972454:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:2.0:1787365264.972457:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365264.972461:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb477d1 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.972468:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb477d1 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.972482:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb477d8 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.972488:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb477d8 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.972493:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb477d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.972498:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365264.972501:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb477d8 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.972506:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb477d8 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.972523:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f27988df400) 00010000:00010000:2.0:1787365264.972526:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365264.972529:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb477d8 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.972535:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb477d8 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.972550:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb477df lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.972556:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb477df lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.972562:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb477df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.972566:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365264.972570:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb477df lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.972576:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb477df lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.972583:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:2.0:1787365264.972585:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365264.972588:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb477df lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365264.972593:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb477df lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365264.972991:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b35500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+52:11482:x1874188003517952:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 3702us (4041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365264.973003:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 164 00000100:00100000:1.0:1787365264.977445:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365264.977543:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003518208 00000100:00100000:0.0:1787365264.977552:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003518208 00000100:00100000:0.0:1787365264.977613:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:0.0:1787365264.977660:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+52:11482:x1874188003518208:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1787365264.977954:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b34700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+53:11482:x1874188003518208:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 331us (516us total) trans 4294967452 rc 0/0 00000100:00100000:0.0:1787365264.977962:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:1.0:1787365265.056903:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365265.056994:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003518464 00000100:00100000:3.0:1787365265.057003:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003518464 00000100:00100000:3.0:1787365265.057069:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00100000:3.0:1787365265.057087:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+53:11485:x1874188003518464:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1787365265.057113:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365265.057133:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb477e6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898927a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057204:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb477ed lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057218:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb477ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057229:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb477ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057241:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb477f4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057248:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb477f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057254:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb477f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057388:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb477fb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057397:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb477fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057404:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb477fb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365265.057424:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787365265.057519:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb477ed lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057527:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb477ed lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057533:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb477ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057539:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365265.057543:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb477ed lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057550:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb477ed lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057561:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:3.0:1787365265.057564:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365265.057568:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb477ed lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057574:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb477ed lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057585:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb477f4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057591:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb477f4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057607:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb477f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057612:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365265.057615:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb477f4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057621:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb477f4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057686:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f2789e48100) 00010000:00010000:3.0:1787365265.057689:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365265.057692:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb477f4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057698:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb477f4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057739:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb477e6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898927a expref: 56 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057753:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb477fb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898927a expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.057760:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:3.0:1787365265.057761:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787365265.057764:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44400, rc 0) 00000100:00100000:3.0:1787365265.058060:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798024380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+55:11485:x1874188003518464:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 964us (1273us total) trans 4294967453 rc 0/0 00000100:00100000:3.0:1787365265.058077:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 165 00000100:00100000:1.0:1787365265.062724:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365265.062763:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365265.062948:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003518720 00000100:00100000:3.0:1787365265.062958:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003518720 00000100:00100000:3.0:1787365265.063016:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1787365265.063027:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798027480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+55:2359:x1874188003518720:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365265.063042:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365265.063078:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb477fb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898927a expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.063097:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:3.0:1787365265.063102:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365265.063432:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003518592 00000100:00100000:0.0:1787365265.063437:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003518592 00000100:00100000:0.0:1787365265.063475:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 166 00000100:00100000:0.0:1787365265.063484:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+55:11485:x1874188003518592:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:0.0:1787365265.063536:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47809 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365265.063549:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365265.063571:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365265.063595:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47809 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365265.063601:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47809 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365265.063608:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47809 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365265.063613:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2045800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365265.063616:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47809 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365265.063642:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47809 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365265.063652:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:0.0:1787365265.063654:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787365265.063657:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47809 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365265.063662:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47809 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365265.064551:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798027480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+55:2359:x1874188003518720:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 1523us (1783us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365265.064561:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:0.0:1787365265.064925:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798027100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+54:11485:x1874188003518592:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 1441us (2209us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365265.064934:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 166 00000100:00100000:0.0:1787365265.068091:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365265.068548:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003518976 00000100:00100000:1.0:1787365265.068558:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003518976 00000100:00100000:1.0:1787365265.068666:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:1.0:1787365265.068678:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+54:11485:x1874188003518976:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:1.0:1787365265.069097:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+55:11485:x1874188003518976:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 420us (1012us total) trans 4294967454 rc 0/0 00000100:00100000:1.0:1787365265.069105:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:1.0:1787365265.266842:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bae84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024490880:0@lo:400:kworker.0 00000100:00100000:0.0:1787365265.266842:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024491008:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365265.267009:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365265.271108:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365265.271166:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:0.0:1787365265.271178:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024491392:0@lo:400:kworker.0 00000100:00100000:0.0:1787365265.271219:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365265.271497:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024491008 00000100:00100000:0.0:1787365265.271505:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024491008 00000100:00100000:0.0:1787365265.271574:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787365265.271585:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024491008:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787365265.271620:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 45940736 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787365265.271686:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb842a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024491008:12345-0@lo:13:osp-pre-1-0.0 Request processed in 103us (584us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365265.271693:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:0.0:1787365265.271719:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024491264:0@lo:400:kworker.0 00000100:00100000:0.0:1787365265.271747:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365265.271767:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:0.0:1787365265.271773:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bae87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024491136:0@lo:400:kworker.0 00000100:00100000:0.0:1787365265.271791:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365265.271821:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024491392 00000100:00100000:0.0:1787365265.271825:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024491392 00000100:00100000:0.0:1787365265.271852:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:0.0:1787365265.271859:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb31df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024491392:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365265.271888:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb31df80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024491392:12345-0@lo:400:kworker.0 Request processed in 30us (669us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365265.271894:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00080000:0.0:1787365265.271912:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787365265.271916:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787365265.271953:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967306 gen 2 00000004:00080000:0.0:1787365265.271959:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967306 committed transno 4294967306 00000100:00100000:0.0:1787365265.271978:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024491392:0@lo:400:kworker.0 00000100:00100000:0.0:1787365265.271993:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb559500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024491008:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787365265.272014:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024491264 00000100:00100000:0.0:1787365265.272017:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024491264 00000100:00100000:3.0:1787365265.275196:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024491136 00000100:00100000:3.0:1787365265.275211:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024491136 00000100:00100000:3.0:1787365265.275274:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787365265.275283:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024491136:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365265.275380:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c45880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024491136:12345-0@lo:400:kworker.0 Request processed in 98us (3586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365265.275387:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 165 00000100:00100000:3.0:1787365265.275505:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024490880 00000100:00100000:3.0:1787365265.275510:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024490880 00000100:00100000:3.0:1787365265.275539:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 299 00000100:00100000:3.0:1787365265.275546:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024490880:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365265.275590:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bae87b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024491136:0@lo:400:kworker.0 00000100:00080000:0.0:1787365265.275616:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365265.275660:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 166 00000100:00100000:0.0:1787365265.275669:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024491264:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365265.280514:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024491520:0@lo:400:kworker.0 00000100:00100000:3.0:1787365265.284274:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e1a450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024490880:12345-0@lo:400:kworker.0 Request processed in 8718us (17255us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365265.284307:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 299 00000100:00100000:1.0:1787365265.284785:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bae84380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024490880:0@lo:400:kworker.0 00000100:00100000:0.0:1787365265.288727:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c44a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024491264:12345-0@lo:400:kworker.0 Request processed in 13050us (16968us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365265.288741:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 166 00000100:00100000:1.0:1787365265.288899:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbadaa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024491264:0@lo:400:kworker.0 00000100:00100000:2.0:1787365265.291525:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365265.301280:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024491520 00000100:00100000:3.0:1787365265.301294:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024491520 00000100:00100000:3.0:1787365265.301369:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 167 00000100:00100000:3.0:1787365265.301379:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024491520:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365265.301472:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024491520:12345-0@lo:400:kworker.0 Request processed in 94us (9952us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365265.301480:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 167 00000100:00100000:2.0:1787365265.303070:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024491520:0@lo:400:kworker.0 00000100:00100000:1.0:1787365265.304349:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365265.304437:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003519232 00000100:00100000:2.0:1787365265.304445:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003519232 00000100:00080000:0.0:1787365265.304496:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365265.304508:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 167 00000100:00100000:2.0:1787365265.304519:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+55:11503:x1874188003519232:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:2.0:1787365265.304542:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365265.304561:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47810 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989281 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365265.304693:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47817 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365265.304707:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47817 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365265.304718:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47817 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365265.304728:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787365265.304849:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47810 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989281 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365265.304898:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47817 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989281 expref: 57 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365265.304908:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:2.0:1787365265.304911:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:2.0:1787365265.304914:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb709400, rc 0) 00000100:00100000:2.0:1787365265.304974:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798025880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+57:11503:x1874188003519232:12345-192.168.203.13@tcp:101:cat.0 Request processed in 457us (632us total) trans 4294967455 rc 0/0 00000100:00100000:2.0:1787365265.304982:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 167 00000100:00100000:3.0:1787365265.382195:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365265.382420:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003519360 00000100:00100000:0.0:1787365265.382430:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003519360 00000100:00100000:0.0:1787365265.382494:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 168 00000100:00100000:0.0:1787365265.382504:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb55ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+57:11504:x1874188003519360:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1787365265.382530:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365265.382550:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47825 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989288 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365265.382616:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4782c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365265.382671:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4782c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365265.382703:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4782c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365265.382761:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 512 00000004:00200000:0.0:1787365265.382765:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787365265.382785:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4782c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365265.382811:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb47825 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989288 expref: 59 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365265.382830:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4782c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989288 expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365265.382839:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:0.0:1787365265.382843:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787365265.382847:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27c2045800, rc 0) 00000100:00100000:0.0:1787365265.382901:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb55ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+58:11504:x1874188003519360:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 397us (715us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365265.382909:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 168 00000100:00100000:0.0:1787365265.401202:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365265.401458:0:11946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003519744 00000100:00100000:2.0:1787365265.401466:0:11946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003519744 00000100:00100000:2.0:1787365265.401522:0:11946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:2.0:1787365265.401533:0:11946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+58:11504:x1874188003519744:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1787365265.402195:0:11946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+59:11504:x1874188003519744:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 661us (998us total) trans 4294967456 rc 0/0 00000100:00100000:3.0:1787365265.402203:0:11946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:2.0:1787365265.410442:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365265.410764:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003519872 00000100:00100000:1.0:1787365265.410784:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003519872 00000100:00100000:1.0:1787365265.410851:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1787365265.410861:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbadb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+59:11504:x1874188003519872:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:1.0:1787365265.410877:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:1.0:1787365265.410903:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb477bc lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898926c expref: 59 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365265.410928:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47817 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989281 expref: 58 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365265.410942:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb476c7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898922d expref: 57 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365265.410952:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ad600) 00010000:00010000:1.0:1787365265.410963:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365265.411020:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbadb800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+56:11504:x1874188003519872:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 161us (589us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365265.411027:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1787365265.414339:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365265.414428:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003520000 00000100:00100000:2.0:1787365265.414437:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003520000 00000100:00100000:2.0:1787365265.414496:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00100000:2.0:1787365265.414506:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+56:11504:x1874188003520000:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:2.0:1787365265.414606:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47833 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365265.414622:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365265.414687:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787365265.414884:0:5833:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].4, 136 off8736 00000100:00100000:2.0:1787365265.414963:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798025180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+56:11504:x1874188003520000:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 458us (632us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365265.414971:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00100000:0.0:1787365265.438480:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365265.438574:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003520128 00000100:00100000:3.0:1787365265.438583:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003520128 00000100:00100000:3.0:1787365265.438679:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 170 00000100:00100000:3.0:1787365265.438691:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+56:11506:x1874188003520128:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1787365265.438711:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365265.438731:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4783a lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898928f expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.438795:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47841 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.438810:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47841 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.438820:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47841 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.438860:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47848 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.438867:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.438874:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.438977:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb4784f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.438987:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb4784f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.438993:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb4784f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365265.439025:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787365265.439029:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787365265.439044:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb4784f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x53/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.439067:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb4784f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.439075:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47841 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.439081:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47841 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.439098:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47841 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.439105:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365265.439109:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47841 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.439116:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47841 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.439128:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:3.0:1787365265.439131:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365265.439135:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47841 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.439141:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47841 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.439154:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47848 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.439159:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47848 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.439164:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47848 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.439169:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365265.439172:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47848 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.439188:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47848 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.439196:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f2789e48100) 00010000:00010000:3.0:1787365265.439198:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365265.439201:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47848 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.439206:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47848 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.439238:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4783a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898928f expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.439251:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb4784f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898928f expref: 57 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365265.439258:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f27988df400) 00010000:00010000:3.0:1787365265.439260:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787365265.439263:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45000, rc 0) 00000100:00100000:3.0:1787365265.439330:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c46680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+57:11506:x1874188003520128:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 641us (859us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365265.439337:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 170 00010000:00010000:1.0:1787365265.778988:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787365266.230954:0:11664:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787365266.230964:0:11664:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787365266.231012:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:3.0:1787365266.231022:0:11664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787365266.231230:0:11664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb559c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11664:1874188024491648:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787365266.231371:0:11664:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b690bf00 going to sleep for 11 seconds 00000100:00100000:0.0:1787365266.244140:0:11664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb559c00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11664:1874188024491648:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787365266.253094:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365266.253448:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003520256 00000100:00100000:3.0:1787365266.253458:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003520256 00000100:00100000:3.0:1787365266.253535:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 171 00000100:00100000:3.0:1787365266.253547:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+57:11517:x1874188003520256:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787365266.253580:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787365266.253716:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+57:11517:x1874188003520256:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 173us (642us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365266.253724:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 171 00000100:00080000:0.0:1787365266.254296:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365266.281422:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365266.284169:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003520384 00000100:00100000:3.0:1787365266.284181:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003520384 00000100:00100000:3.0:1787365266.284277:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 172 00000100:00100000:3.0:1787365266.284288:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+57:11517:x1874188003520384:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787365266.284366:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb47856 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284381:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb47856 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284395:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb47856 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284408:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb4785d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284415:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb4785d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284421:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb4785d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284453:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47864 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284461:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284467:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365266.284510:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00000004:00200000:3.0:1787365266.284514:0:5834:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787365266.284526:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284536:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb47856 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284542:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb47856 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284549:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb47856 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284554:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365266.284558:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb47856 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284564:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb47856 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284574:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f27988dfd00) 00010000:00010000:3.0:1787365266.284582:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365266.284588:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb47856 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284593:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb47856 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284603:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb4785d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284608:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb4785d lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284614:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb4785d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284618:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365266.284620:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb4785d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284643:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb4785d lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284651:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x19697575 (ffff9f2789e48100) 00010000:00010000:3.0:1787365266.284654:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365266.284657:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb4785d lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284662:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb4785d lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x19697575 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284686:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47864 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284698:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47864 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284703:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284708:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365266.284711:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47864 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284717:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47864 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284725:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f27988df400) 00010000:00010000:3.0:1787365266.284728:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365266.284731:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47864 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.284736:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47864 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365266.284889:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798024e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+57:11517:x1874188003520384:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 600us (3474us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365266.284898:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 172 00000100:00100000:3.0:1787365266.292434:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365266.292476:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003520640 00000100:00100000:3.0:1787365266.292484:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003520640 00000100:00100000:3.0:1787365266.292528:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 173 00000100:00100000:3.0:1787365266.292537:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+57:11517:x1874188003520640:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787365266.292566:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365266.292585:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb4786b lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989296 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.293186:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47872 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.293202:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.293214:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365266.293225:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:3.0:1787365266.293334:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47872 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.293341:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47872 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.293348:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.293353:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365266.293358:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47872 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.293365:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47872 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.293377:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f27988df400) 00010000:00010000:3.0:1787365266.293386:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787365266.293391:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47872 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.293397:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47872 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.293452:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb4786b lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989296 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.293462:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f27988dfd00) 00010000:00010000:3.0:1787365266.293465:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787365266.293469:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb4786b lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989296 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.293478:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44200, rc 0) 00000100:00100000:3.0:1787365266.293535:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb558380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+58:11517:x1874188003520640:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 999us (1110us total) trans 4294967457 rc 301/301 00000100:00100000:3.0:1787365266.293543:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 173 00000100:00100000:2.0:1787365266.309291:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365266.309333:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003520768 00000100:00100000:2.0:1787365266.309340:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003520768 00000100:00100000:2.0:1787365266.311761:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 174 00000100:00100000:2.0:1787365266.311780:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+58:11517:x1874188003520768:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787365266.311816:0:6704:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xb:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787365266.311937:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+58:11517:x1874188003520768:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 163us (2654us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365266.311944:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 174 00000040:00080000:1.0:1787365266.314268:0:12444:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787365266.314276:0:12444:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787365266.314312:0:12444:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:1.0:1787365266.314318:0:12444:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787365266.316242:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365266.316273:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003521024 00000100:00100000:3.0:1787365266.316281:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003521024 00000100:00100000:3.0:1787365266.316327:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 175 00000100:00100000:3.0:1787365266.316337:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+58:11517:x1874188003521024:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787365266.316356:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365266.316360:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787365266.316387:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4782c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989288 expref: 58 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.316422:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:3.0:1787365266.316427:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787365266.316442:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47880 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898929d expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787365266.317556:0:5833:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x5:0x0], index 1: 0 00010000:00010000:3.0:1787365266.318224:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47887 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.318242:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.318253:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47887 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.318308:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47880 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898929d expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.318325:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47887 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898929d expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.318333:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f2789e48100) 00010000:00010000:3.0:1787365266.318336:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787365266.318339:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44400, rc 0) 00000100:00100000:3.0:1787365266.318407:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+59:11517:x1874188003521024:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 2071us (2171us total) trans 4294967458 rc 0/0 00000100:00100000:3.0:1787365266.318416:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 175 00000100:00100000:3.0:1787365266.342942:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365266.342979:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003521280 00000100:00100000:3.0:1787365266.342989:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003521280 00000100:00100000:3.0:1787365266.343037:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 176 00000100:00100000:3.0:1787365266.343057:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+59:11517:x1874188003521280:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787365266.343119:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365266.343149:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47887 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898929d expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.343167:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f2789e48100) 00010000:00010000:3.0:1787365266.343178:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787365266.343201:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47895 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.343214:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47895 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.343224:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47895 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.343237:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb4789c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x5d0e9ea1 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.343243:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb4789c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5d0e9ea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.343249:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb4789c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5d0e9ea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.343479:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47895 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.343495:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47895 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.343501:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47895 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.343507:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365266.343511:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47895 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.343518:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47895 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.343527:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:3.0:1787365266.343529:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365266.343533:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47895 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.343539:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47895 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.343548:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb4789c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x5d0e9ea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.343553:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb4789c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5d0e9ea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.343558:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb4789c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5d0e9ea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.343562:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365266.343569:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb4789c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5d0e9ea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.343575:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb4789c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x5d0e9ea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.343582:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x5d0e9ea1 (ffff9f2789e48b00) 00010000:00010000:3.0:1787365266.343584:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365266.343587:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb4789c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5d0e9ea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.343592:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb4789c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x5d0e9ea1 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365266.343684:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb559500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+58:11517:x1874188003521280:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 637us (753us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787365266.343692:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 176 00000100:00100000:0.0:1787365266.348799:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365266.348875:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003521408 00000100:00100000:3.0:1787365266.348885:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003521408 00000100:00100000:3.0:1787365266.348940:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 177 00000100:00100000:3.0:1787365266.348949:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+58:11517:x1874188003521408:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787365266.348967:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365266.348989:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb478a3 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989892a4 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.349024:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb478aa lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.349038:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb478aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.349077:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb478aa lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.349174:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb478a3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892a4 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.349191:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb478aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892a4 expref: 59 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.349201:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f2789e48500) 00010000:00010000:3.0:1787365266.349204:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:3.0:1787365266.349208:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45200, rc 0) 00000100:00100000:3.0:1787365266.349260:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae84380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+59:11517:x1874188003521408:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 312us (480us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365266.349267:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 177 00000100:00100000:3.0:1787365266.361019:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365266.361068:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003521664 00000100:00100000:3.0:1787365266.361077:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003521664 00000100:00100000:3.0:1787365266.361123:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 178 00000100:00100000:3.0:1787365266.361133:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+59:11517:x1874188003521664:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787365266.361209:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb478b1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.361226:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb478b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.361237:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb478b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787365266.361486:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].6, 88 off8648 00000004:00080000:3.0:1787365266.363655:0:6704:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 383528027599ns, next at 384528022621ns, rc = 0 00000004:00010000:3.0:1787365266.363799:0:6704:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6a58e5b reply state 000000001a7a7e1b transno 4294967459 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb478b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365266.363811:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787365266.363918:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+61:11517:x1874188003521664:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 2782us (2905us total) trans 4294967459 rc 0/0 00000100:00100000:3.0:1787365266.363928:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 178 00010000:00010000:3.0:1787365266.367974:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb478b1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.368346:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb478b1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.368356:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb478b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.368362:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365266.368368:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb478b1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.368376:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb478b1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.368392:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f2789e48500) 00010000:00010000:3.0:1787365266.368396:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787365266.368402:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb478b1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.368420:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb478b1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365266.372983:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365266.373020:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003521792 00000100:00100000:3.0:1787365266.373030:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003521792 00000100:00100000:3.0:1787365266.373091:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 179 00000100:00100000:3.0:1787365266.373102:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+60:11517:x1874188003521792:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787365266.373126:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365266.373145:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb478b8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989892ab expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.373207:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb478b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ab expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.373222:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb478b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ab expref: 61 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.373240:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f2789e48500) 00010000:00010000:3.0:1787365266.373243:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:3.0:1787365266.373247:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45a00, rc 0) 00000100:00100000:3.0:1787365266.373300:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb558a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+61:11517:x1874188003521792:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 200us (324us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365266.373308:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 179 00000100:00100000:2.0:1787365266.383766:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365266.384247:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003521920 00000100:00100000:3.0:1787365266.384258:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003521920 00000100:00100000:3.0:1787365266.384323:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:3.0:1787365266.384496:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2361:x1874188003521920:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00100000:3.0:1787365266.384821:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbadad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2361:x1874188003521920:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 328us (1063us total) trans 4294967313 rc 0/0 00000100:00080000:0.0:1787365266.384872:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787365266.386306:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000001:00080000:1.0:1787365266.389893:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967452 is committed 00000004:00080000:1.0:1787365266.389922:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 4 committed 00000020:00080000:1.0:1787365266.389947:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f2686c77900 refcount 2 committed 0 result 0 batchid 5 00000020:00080000:1.0:1787365266.389951:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f27bf0a4700 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f2686c77cc0 00000020:00080000:1.0:1787365266.389955:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f27bf0a4000 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f27b6b59800 00000001:00080000:1.0:1787365266.389978:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967454 is committed 00000001:00080000:1.0:1787365266.389990:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967456 is committed 00000004:00080000:1.0:1787365266.389999:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 5 committed 00000020:00080000:1.0:1787365266.390139:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 5 committed batchid 4 00000020:00080000:1.0:1787365266.390288:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 4 00000100:00100000:1.0:1787365266.390307:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2798024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024491776:0@lo:6:osp-syn-0-0.0 00000100:00100000:1.0:1787365266.390376:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365266.390445:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024491776 00000100:00100000:1.0:1787365266.390451:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024491776 00000100:00100000:1.0:1787365266.390491:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787365266.390500:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024491776:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787365266.390523:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:4 count 1 00002000:00010000:1.0:1787365266.390555:0:6682:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x4:0x0] initial LVB size: 13, mtime: 0x6a89078e, atime: 0x6a89078e, ctime: 0x6a89078e, blocks: 0xb 00010000:00010000:1.0:1787365266.390563:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95872be/0x872d29295eb478bf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.390580:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=383s v=(0 0) 00010000:00010000:1.0:1787365266.390584:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x4:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365266.390591:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d95872be/0x872d29295eb478bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.390606:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d95872be/0x872d29295eb478bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.390671:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d95872be/0x872d29295eb478bf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.390679:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d95872be/0x872d29295eb478bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.390694:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:1.0:1787365266.391146:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798024700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3310:x1874188024491776:12345-0@lo:6:osp-syn-0-0.0 Request processed in 646us (768us total) trans 4294967307 rc 0/0 00000100:00100000:1.0:1787365266.391155:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00010000:00010000:1.0:1787365266.391182:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365266.391189:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d95872be/0x872d29295eb478bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.391198:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114600 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365266.391203:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95872be/0x872d29295eb478bf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.391213:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d95872be/0x872d29295eb478bf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.391229:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d95872be/0x872d29295eb478bf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.391237:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d95872be/0x872d29295eb478bf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.391262:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365266.391264:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365266.391265:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:1.0:1787365266.391296:0:3310:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2798024a80/2, rc 0, transno 4294967307 00000100:00100000:1.0:1787365266.391302:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2798024a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024491776:0@lo:6:osp-syn-0-0.0 00000100:00100000:2.0:1787365266.398108:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365266.398494:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003522176 00000100:00100000:3.0:1787365266.398503:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003522176 00000100:00100000:3.0:1787365266.398553:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:3.0:1787365266.398562:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+20:11517:x1874188003522176:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:3.0:1787365266.398848:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:11517:x1874188003522176:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 286us (748us total) trans 4294967460 rc 0/0 00000100:00100000:3.0:1787365266.398856:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:3.0:1787365266.401688:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365266.401761:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003522432 00000100:00100000:0.0:1787365266.401833:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003522432 00000100:00100000:0.0:1787365266.401886:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 180 00000100:00100000:0.0:1787365266.401895:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:11517:x1874188003522432:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787365266.401989:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb558700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:11517:x1874188003522432:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 95us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365266.401996:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 180 00000100:00100000:0.0:1787365266.408800:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365266.408837:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003522560 00000100:00100000:0.0:1787365266.408845:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003522560 00000100:00100000:0.0:1787365266.408894:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 181 00000100:00100000:0.0:1787365266.408904:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bae87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:11517:x1874188003522560:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787365266.408924:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365266.408945:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb478c6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989892b2 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.409013:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb478cd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.409027:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb478cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.409038:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb478cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365266.409084:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787365266.409101:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb478cd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.409126:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb478c6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892b2 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.409152:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb478cd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892b2 expref: 22 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.409160:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f2789e48500) 00010000:00010000:0.0:1787365266.409163:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:0.0:1787365266.409166:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27c2045a00, rc 0) 00000100:00100000:0.0:1787365266.409218:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bae87b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+22:11517:x1874188003522560:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 315us (425us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365266.409225:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 181 00000100:00100000:3.0:1787365266.416002:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365266.416085:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003522688 00000100:00100000:0.0:1787365266.416095:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003522688 00000100:00100000:0.0:1787365266.416150:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:0.0:1787365266.416161:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb558000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2362:x1874188003522688:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787365266.416178:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365266.416200:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b5ed8339/0x872d29295eb478d4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989892b9 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787365266.416227:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a890791, blocks: 0x1 00010000:00010000:0.0:1787365266.416246:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=383s v=(0 0) 00010000:00010000:0.0:1787365266.416250:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365266.416261:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b5ed8339/0x872d29295eb478d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892b9 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.416279:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000b5ed8339/0x872d29295eb478d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892b9 expref: 8 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.416308:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27c2045400, rc 0) 00000100:00100000:0.0:1787365266.416361:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb558000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2362:x1874188003522688:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 202us (369us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365266.416369:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:3.0:1787365266.419288:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365266.419362:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003522944 00000100:00100000:2.0:1787365266.419372:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003522944 00000100:00100000:2.0:1787365266.419866:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 182 00000100:00100000:2.0:1787365266.419878:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb55a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+22:11517:x1874188003522944:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787365266.419984:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb55a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+22:11517:x1874188003522944:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 108us (704us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365266.419992:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 182 00000100:00100000:0.0:1787365266.424934:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365266.425007:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003523072 00000100:00100000:2.0:1787365266.425017:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003523072 00000100:00100000:2.0:1787365266.425088:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:2.0:1787365266.425099:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:11517:x1874188003523072:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365266.425116:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365266.425133:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000c470320c/0x872d29295eb478db lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989892c0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.425166:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000b5ed8339/0x872d29295eb478d4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892b9 expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.425175:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365266.425180:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365266.425185:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c470320c/0x872d29295eb478db lrc: 4/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892c0 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.425217:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000b5ed8339/0x872d29295eb478d4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892b9 expref: 9 pid: 6681 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.425230:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000b5ed8339/0x872d29295eb478d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892b9 expref: 9 pid: 6681 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365266.425244:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbad8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1874188024491904:192.168.203.13@tcp:104: 00000100:00100000:2.0:1787365266.425393:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473f000 going to sleep for 11 seconds 00000100:00100000:0.0:1787365266.432052:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365266.432868:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003523200 00000100:00100000:1.0:1787365266.432879:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003523200 00010000:00010000:1.0:1787365266.432920:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000b5ed8339/0x872d29295eb478d4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892b9 expref: 10 pid: 6681 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365266.432961:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:1.0:1787365266.432972:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+10:2361:x1874188003523200:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365266.432987:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365266.433009:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000b5ed8339/0x872d29295eb478d4 lrc: 5/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892b9 expref: 10 pid: 6681 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.433022:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000b5ed8339/0x872d29295eb478d4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892b9 expref: 10 pid: 6681 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.433060:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365266.433065:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365266.433074:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000c470320c/0x872d29295eb478db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892c0 expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.433084:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000c470320c/0x872d29295eb478db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50080000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892c0 expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.433129:0:5819:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000c470320c/0x872d29295eb478db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892c0 expref: 10 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365266.433143:0:5819:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2798024000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5819:1874188024492032:192.168.203.13@tcp:105: 00000100:00100000:1.0:1787365266.433219:0:5819:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bcfb9b40 going to sleep for 11 seconds 00010000:00010000:2.0:1787365266.436831:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b5ed8339/0x872d29295eb478d4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892b9 expref: 10 pid: 6681 timeout: 483 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365266.436857:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbad8380 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1874188024491904:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365266.436899:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000c470320c/0x872d29295eb478db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892c0 expref: 9 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.436915:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb708400, rc 0) 00000100:00100000:2.0:1787365266.436988:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb843b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:11517:x1874188003523072:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 11890us (12062us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365266.436997:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:3.0:1787365266.438840:0:5819:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2798024000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:5819:1874188024492032:192.168.203.13@tcp:105: 00010000:00010000:3.0:1787365266.438860:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365266.438909:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8d180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2361:x1874188003523200:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 5938us (6874us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365266.438920:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:3.0:1787365266.444068:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365266.444182:0:6687:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003523328 00000100:00100000:0.0:1787365266.444191:0:6687:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003523328 00002000:00100000:0.0:1787365266.444241:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9f27bb55b100 x1874188003523328/t0(0) o4->8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp:172/0 lens 504/0 e 0 to 0 dl 1787365277 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787365266.444252:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f27bb55b100 with x1874188003523328 ext(0->8) 00002000:00010000:0.0:1787365266.444258:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f27bb55b100 00000100:00100000:0.0:1787365266.444294:0:6687:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:0.0:1787365266.444304:0:6687:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb55b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2362:x1874188003523328:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:0.0:1787365266.444760:0:6687:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb55b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+10:2362:x1874188003523328:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 455us (698us total) trans 4294967314 rc 0/0 00000100:00100000:0.0:1787365266.444780:0:6687:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00002000:00100000:0.0:1787365266.444788:0:6687:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_001: refresh rw locks for [0x280000400:0x5:0x0] (0->8) req@ffff9f27bb55b100 x1874188003523328/t4294967314(0) o4->8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp:172/0 lens 504/448 e 0 to 0 dl 1787365277 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:0.0:1787365266.444797:0:6687:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f27bb55b100 with x1874188003523328 ext(0->8) 00002000:00010000:0.0:1787365266.444801:0:6687:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f27bb55b100 00000100:00100000:2.0:1787365266.458218:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365266.458291:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003523456 00000100:00100000:3.0:1787365266.458300:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003523456 00000100:00100000:3.0:1787365266.458391:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 183 00000100:00100000:3.0:1787365266.458401:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+22:11517:x1874188003523456:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000020:00080000:1.0:1787365266.527014:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 5 batchid updated 00000020:00080000:1.0:1787365266.527037:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000020:00080000:1.0:1787365266.527055:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000001:00080000:1.0:1787365266.527074:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967460 is committed 00000004:00080000:1.0:1787365266.527083:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 8 committed 00000100:00100000:1.0:1787365266.527214:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2798025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024492160:0@lo:2:osp-syn-1-0.0 00000100:00100000:1.0:1787365266.527281:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365266.527345:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024492160 00000100:00100000:1.0:1787365266.527351:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024492160 00000100:00100000:1.0:1787365266.527388:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:1.0:1787365266.527397:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024492160:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:1.0:1787365266.527533:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:1.0:1787365266.527537:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787365265 00002000:00010000:1.0:1787365266.527540:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:1.0:1787365266.527542:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787365265 -> 1787365265 00002000:00010000:1.0:1787365266.527543:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:1.0:1787365266.527582:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798026a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3311:x1874188024492160:12345-0@lo:2:osp-syn-1-0.0 Request processed in 186us (301us total) trans 4294967315 rc 0/0 00000100:00100000:1.0:1787365266.527589:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000004:00080000:1.0:1787365266.527658:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f2798025f80/2, rc 0, transno 4294967315 00000100:00100000:1.0:1787365266.527923:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2798025f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024492160:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787365266.531397:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad8380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:11517:x1874188003523456:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 72989us (73180us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365266.531421:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 183 00000100:00100000:3.0:1787365266.539949:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365266.539996:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003523584 00000100:00100000:3.0:1787365266.540005:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003523584 00000100:00100000:3.0:1787365266.540065:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:3.0:1787365266.540075:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb55b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+10:2362:x1874188003523584:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000001:00080000:2.0:1787365266.575374:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967314 is committed 00000001:00080000:2.0:1787365266.575394:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967315 is committed 00000100:00100000:3.0:1787365266.575778:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb55b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2362:x1874188003523584:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 35699us (35834us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365266.575790:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:3.0:1787365266.578503:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365266.578594:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003523840 00000100:00100000:0.0:1787365266.578604:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003523840 00000100:00100000:0.0:1787365266.578688:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 184 00000100:00100000:0.0:1787365266.578697:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:11517:x1874188003523840:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787365266.578749:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365266.578782:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb478cd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892b2 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.578803:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f2789e48500) 00010000:00010000:0.0:1787365266.578807:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787365266.578833:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb478e2 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.578845:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb478e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.578854:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb478e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787365266.579080:0:6704:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000c6409b6f reply state 00000000c671eb65 transno 4294967461 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb478e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365266.579089:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787365266.579170:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63b1880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+19:11517:x1874188003523840:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 474us (675us total) trans 4294967461 rc 0/0 00000100:00100000:0.0:1787365266.579177:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 184 00000100:00100000:2.0:1787365266.583695:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365266.584234:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003523968 00000100:00100000:1.0:1787365266.584244:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003523968 00000100:00100000:1.0:1787365266.584302:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:1.0:1787365266.584313:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbadb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2362:x1874188003523968:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:1.0:1787365266.584561:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 9 00002000:00010000:1.0:1787365266.584565:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787365265 -> 1787365264 00002000:00010000:1.0:1787365266.584567:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787365262 00002000:00010000:1.0:1787365266.584569:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787365265 -> 1787365264 00002000:00010000:1.0:1787365266.584572:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:1.0:1787365266.584643:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbadb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2362:x1874188003523968:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 313us (945us total) trans 4294967316 rc 0/0 00000100:00100000:1.0:1787365266.584650:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00010000:00010000:0.0:1787365266.586983:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb478e2 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.587016:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb478e2 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.587022:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb478e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.587028:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780031a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365266.587032:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb478e2 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.587039:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb478e2 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.587065:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f2789e48500) 00010000:00010000:0.0:1787365266.587068:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365266.587073:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb478e2 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.587079:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb478e2 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365266.587818:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365266.587972:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003524224 00000100:00100000:2.0:1787365266.587980:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003524224 00000100:00100000:2.0:1787365266.588027:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 185 00000100:00100000:2.0:1787365266.588035:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:11517:x1874188003524224:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787365266.588107:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb478e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.588122:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb478aa lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892a4 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.588132:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb478e9 lrc: 4/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.588165:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb478aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892a4 expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.588177:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb478aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892a4 expref: 18 pid: 5833 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365266.588200:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbadb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874188024492288:192.168.203.13@tcp:104: 00000100:00100000:2.0:1787365266.588282:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473f000 going to sleep for 11 seconds 00000100:00100000:2.0:1787365266.591794:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365266.592004:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbadb480 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874188024492288:192.168.203.13@tcp:104: 00010000:00010000:0.0:1787365266.592028:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb478e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365266.592217:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003524352 00000100:00100000:3.0:1787365266.592225:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003524352 00010000:00010000:3.0:1787365266.592262:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb478aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892a4 expref: 19 pid: 5833 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365266.592300:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:3.0:1787365266.592311:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27882bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+19:2362:x1874188003524352:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365266.592325:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365266.592331:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb478aa lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892a4 expref: 19 pid: 5833 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.592344:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb478aa lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892a4 expref: 19 pid: 5833 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.592365:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb478aa lrc: 0/0,0 mode: --/PR res: [0x200000401:0xd:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892a4 expref: 19 pid: 5833 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.592379:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f2789e48500) 00010000:00010000:3.0:1787365266.592397:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb478e9 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.592407:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb478e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.592414:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb478e9 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.592442:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365266.592497:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27882bac50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:2362:x1874188003524352:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 188us (711us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365266.592506:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00010000:00010000:0.0:1787365266.593178:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb478e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.593188:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb478e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.593230:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb478e9 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.593235:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb478e9 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.593241:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb478e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.593247:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365266.593251:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb478e9 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.593257:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb478e9 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.593268:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f2789e48500) 00010000:00010000:0.0:1787365266.593270:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787365266.593273:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb478e9 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.593279:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb478e9 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365266.593339:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63b1180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+17:11517:x1874188003524224:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 5303us (5525us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787365266.593346:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 185 00000100:00100000:2.0:1787365266.598362:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365266.598493:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003524480 00000100:00100000:0.0:1787365266.598503:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003524480 00000100:00100000:0.0:1787365266.598560:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:0.0:1787365266.598583:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2362:x1874188003524480:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787365266.598664:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000021ffbcf0/0x872d29295eb478f0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.598693:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000c470320c/0x872d29295eb478db lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892c0 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.598703:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365266.598707:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787365266.598712:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021ffbcf0/0x872d29295eb478f0 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.598748:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000c470320c/0x872d29295eb478db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892c0 expref: 8 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.598761:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000c470320c/0x872d29295eb478db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892c0 expref: 8 pid: 6682 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365266.598785:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2788f8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1874188024492416:192.168.203.13@tcp:104: 00000100:00100000:0.0:1787365266.598855:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b64c6540 going to sleep for 11 seconds 00000100:00100000:0.0:1787365266.602425:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2788f8df80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1874188024492416:192.168.203.13@tcp:104: 00010000:00010000:0.0:1787365266.602454:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000021ffbcf0/0x872d29295eb478f0 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365266.603262:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365266.603519:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003524608 00000100:00100000:3.0:1787365266.603527:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003524608 00010000:00010000:3.0:1787365266.603565:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000c470320c/0x872d29295eb478db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892c0 expref: 9 pid: 6682 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365266.603603:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:3.0:1787365266.603612:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:2362:x1874188003524608:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365266.603661:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365266.603694:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000c470320c/0x872d29295eb478db lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892c0 expref: 9 pid: 6682 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.603711:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000c470320c/0x872d29295eb478db lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892c0 expref: 9 pid: 6682 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.603734:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000c470320c/0x872d29295eb478db lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892c0 expref: 9 pid: 6682 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.603778:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787365266.603782:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787365266.603788:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000021ffbcf0/0x872d29295eb478f0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.603797:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000021ffbcf0/0x872d29295eb478f0 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.603829:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365266.603875:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad9180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2362:x1874188003524608:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 263us (617us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365266.603883:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00010000:00010000:2.0:1787365266.604021:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000021ffbcf0/0x872d29295eb478f0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.604030:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000021ffbcf0/0x872d29295eb478f0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.604066:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000021ffbcf0/0x872d29295eb478f0 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.604074:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000021ffbcf0/0x872d29295eb478f0 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.604082:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000021ffbcf0/0x872d29295eb478f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.604089:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780031c00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:2.0:1787365266.604093:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000021ffbcf0/0x872d29295eb478f0 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.604102:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000021ffbcf0/0x872d29295eb478f0 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.604122:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000021ffbcf0/0x872d29295eb478f0 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.604129:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000021ffbcf0/0x872d29295eb478f0 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365266.604175:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad9880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2362:x1874188003524480:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 5595us (5822us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365266.604183:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:1.0:1787365266.607077:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365266.607174:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003524864 00000100:00100000:0.0:1787365266.607195:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003524864 00000100:00100000:0.0:1787365266.607254:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 186 00000100:00100000:0.0:1787365266.607264:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+17:11517:x1874188003524864:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787365266.607355:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb478f7 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.607373:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb478f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.607385:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb478f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.607581:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb478fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.607594:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb478b8 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ab expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.607603:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb478fe lrc: 4/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.607678:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb478b8 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ab expref: 18 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.607693:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb478b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ab expref: 18 pid: 5833 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365266.607707:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2788f8df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1874188024492544:192.168.203.13@tcp:104: 00000100:00100000:0.0:1787365266.607784:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b64c6540 going to sleep for 11 seconds 00000100:00100000:1.0:1787365266.615285:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365266.615375:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003524992 00000100:00100000:3.0:1787365266.615384:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003524992 00010000:00010000:3.0:1787365266.615424:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb478b8 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ab expref: 19 pid: 5833 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365266.615468:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:3.0:1787365266.615478:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798027800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+19:2361:x1874188003524992:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365266.615494:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365266.615500:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb478b8 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ab expref: 19 pid: 5833 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.615513:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb478b8 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ab expref: 19 pid: 5833 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.615555:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f2789e48500) 00010000:00010000:3.0:1787365266.615560:0:5819:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb478fe lrc: 3/0,1 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.615569:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb478fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.615576:0:5819:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb478fe lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365266.615596:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365266.615692:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798027800 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+19:2361:x1874188003524992:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 215us (416us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365266.615699:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 70 00010000:00010000:0.0:1787365266.616916:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb478b8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ab expref: 18 pid: 5833 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365266.616947:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2788f8df80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1874188024492544:192.168.203.13@tcp:104: 00010000:00010000:0.0:1787365266.616967:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb478fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.617023:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb478fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.617030:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb478fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787365266.617200:0:6704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967462 00000001:00080000:2.0:1787365266.617327:0:6704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967463 00000001:00080000:2.0:1787365266.617511:0:6704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967464 00000100:00100000:2.0:1787365266.617584:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbad8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6704:1874188024492672:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787365266.617838:0:6704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365266.617875:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473fcc0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365266.617945:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024492672 00000100:00100000:1.0:1787365266.617952:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024492672 00000100:00100000:1.0:1787365266.617996:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787365266.618005:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6704:x1874188024492672:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787365266.618099:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6704:x1874188024492672:12345-0@lo:1000:mdt00_003.0 Request processed in 96us (335us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365266.618106:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787365266.618279:0:6704:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967315 gen 2 00000004:00080000:2.0:1787365266.618284:0:6704:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2798025f80, transno 4294967315 00000100:00100000:2.0:1787365266.618302:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbad8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6704:1874188024492672:0@lo:1000:mdt00_003.0 00000001:00080000:2.0:1787365266.620093:0:6704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967465 00000100:00100000:2.0:1787365266.620171:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbad8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6704:1874188024492800:0@lo:1000:mdt00_003.0 00000100:00100000:2.0:1787365266.620237:0:6704:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365266.620264:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787365266.620688:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024492800 00000100:00100000:1.0:1787365266.620695:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024492800 00000100:00100000:1.0:1787365266.620741:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787365266.620750:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+5:6704:x1874188024492800:12345-0@lo:1000:mdt00_003.0 00000100:00100000:1.0:1787365266.621094:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:6704:x1874188024492800:12345-0@lo:1000:mdt00_003.0 Request processed in 345us (856us total) trans 4294967317 rc 0/0 00000100:00100000:1.0:1787365266.621103:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787365266.621291:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbad8e00 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-mdtlov_UUID:6704:1874188024492800:0@lo:1000:mdt00_003.0 00010000:00010000:2.0:1787365266.621327:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb478fe lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.621336:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb478fe lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.621343:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb478fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.621350:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365266.621354:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb478fe lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.621362:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb478fe lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.621376:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f2789e48500) 00010000:00010000:2.0:1787365266.621380:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787365266.621384:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb478fe lrc: 2/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.621391:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb478fe lrc: 0/0,0 mode: --/EX res: [0x200000401:0xd:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.621420:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47833 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.621426:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47833 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.621439:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47833 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.621444:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365266.621447:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47833 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.621453:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47833 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.621462:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f27988df400) 00010000:00010000:2.0:1787365266.621464:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787365266.621467:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47833 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.621473:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47833 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.621492:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47905 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.621506:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb4784f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898928f expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.621515:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47905 lrc: 4/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.621544:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb4784f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898928f expref: 21 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.621570:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb4784f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898928f expref: 21 pid: 5834 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365266.621584:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbad8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1874188024492928:192.168.203.13@tcp:104: 00000100:00100000:2.0:1787365266.621853:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473f540 going to sleep for 11 seconds 00000100:00100000:2.0:1787365266.625939:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbad8000 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1874188024492928:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365266.625969:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47905 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365266.627600:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365266.627901:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003525120 00000100:00100000:1.0:1787365266.627911:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003525120 00010000:00010000:1.0:1787365266.627954:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb4784f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898928f expref: 22 pid: 5834 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365266.627995:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 71 00000100:00100000:1.0:1787365266.628004:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+22:2362:x1874188003525120:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365266.628018:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365266.628023:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb4784f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898928f expref: 22 pid: 5834 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.628035:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb4784f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898928f expref: 22 pid: 5834 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.628069:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb4784f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898928f expref: 22 pid: 5834 timeout: 483 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.628084:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f27988df400) 00010000:00010000:1.0:1787365266.628089:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47905 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.628098:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47905 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.628105:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47905 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.628225:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365266.628280:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:2362:x1874188003525120:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 276us (687us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365266.628288:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 71 00010000:00010000:2.0:1787365266.629252:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47905 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.629263:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47905 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.629276:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47905 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.629282:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47905 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.629288:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47905 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.629294:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365266.629298:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47905 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.629319:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47905 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.629333:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f27988df400) 00010000:00010000:2.0:1787365266.629478:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365266.629485:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47905 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.629492:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47905 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.629509:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb478f7 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.629515:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb478f7 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.629520:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb478f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.629525:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780031a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365266.629528:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb478f7 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.629534:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb478f7 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.629541:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f27988df400) 00010000:00010000:2.0:1787365266.629544:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787365266.629546:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb478f7 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365266.629561:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031a00/0x872d29295eb478f7 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365266.630319:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798026680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+20:11517:x1874188003524864:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 23050us (23245us total) trans 4294967466 rc 0/0 00000100:00100000:2.0:1787365266.630330:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 186 00000020:00080000:2.0:1787365266.630346:0:6704:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:0.0:1787365266.631030:0:11664:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787365266.631036:0:11664:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787365266.631537:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 2 00000040:00080000:0.0:1787365266.631546:0:11664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787365266.635327:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365266.635484:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003525376 00000100:00100000:0.0:1787365266.635494:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003525376 00000100:00100000:0.0:1787365266.635552:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:0.0:1787365266.635562:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278ac6c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+20:11517:x1874188003525376:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:0.0:1787365266.636481:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xd:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:0.0:1787365266.636585:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967467 00010000:00010000:0.0:1787365266.636656:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4790c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.636910:0:5836:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4790c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.636925:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4790c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.636934:0:5836:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4790c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.636940:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4790c lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.636957:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4790c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365266.637021:0:5836:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787365266.637123:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278ac6c850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+22:11517:x1874188003525376:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 1560us (1803us total) trans 4294967468 rc 0/0 00000100:00100000:0.0:1787365266.637133:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000020:00080000:0.0:1787365266.637139:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:1.0:1787365266.638298:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365266.638308:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4790c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.638316:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030800 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365266.638320:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4790c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.638329:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4790c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.638354:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xd:0x0].0x0 (ffff9f278a0ad200) 00010000:00010000:1.0:1787365266.638357:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787365266.638362:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4790c lrc: 1/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.638368:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4790c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xd:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365266.638389:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365266.638391:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365266.638392:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365266.807111:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365267.832875:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787365268.338421:0:12498:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787365268.338430:0:12498:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787365268.338468:0:12498:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 5 count 2 00000040:00080000:0.0:1787365268.338473:0:12498:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:1.0:1787365268.472952:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365268.473081:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003525632 00000100:00100000:3.0:1787365268.473092:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003525632 00000100:00100000:3.0:1787365268.473160:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 187 00000100:00100000:3.0:1787365268.473171:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+22:11536:x1874188003525632:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1787365268.473195:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365268.473216:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47913 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989892c7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.473472:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4791a lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.473488:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4791a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.473500:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4791a lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365268.473519:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00010000:00010000:3.0:1787365268.473733:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47913 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892c7 expref: 25 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.473750:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4791a lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892c7 expref: 24 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.473759:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:3.0:1787365268.473761:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:3.0:1787365268.473765:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44c00, rc 0) 00000100:00100000:3.0:1787365268.473823:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798025f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+24:11536:x1874188003525632:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 654us (881us total) trans 4294967469 rc 0/0 00000100:00100000:3.0:1787365268.473831:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 187 00000100:00080000:1.0:1787365268.474641:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365268.478291:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365268.480059:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003525760 00000100:00100000:2.0:1787365268.480073:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003525760 00000100:00100000:2.0:1787365268.480141:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 188 00000100:00100000:2.0:1787365268.480152:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+24:11536:x1874188003525760:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:2.0:1787365268.480226:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47928 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.480244:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47928 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.480256:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47928 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.480272:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb4792f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.480279:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb4792f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.480286:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb4792f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.480590:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47936 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.480600:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.480607:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787365268.480668:0:5834:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.480681:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47928 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.480688:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47928 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.480695:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47928 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.480701:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365268.480706:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47928 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.482295:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47928 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.482318:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:2.0:1787365268.482321:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365268.482327:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47928 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.482342:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47928 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.482357:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb4792f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.482364:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb4792f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.482371:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb4792f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.482377:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365268.482381:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb4792f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.482387:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb4792f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.482394:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f27988dfa00) 00010000:00010000:2.0:1787365268.482397:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365268.482400:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb4792f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.482405:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb4792f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.482421:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47936 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.482427:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47936 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.482438:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47936 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.482443:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365268.482446:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47936 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.482452:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47936 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.482459:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f27988df900) 00010000:00010000:2.0:1787365268.482461:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365268.482464:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47936 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.482469:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47936 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365268.482861:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63b0e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+24:11536:x1874188003525760:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 2706us (4573us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365268.482872:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 188 00000100:00100000:3.0:1787365268.566711:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365268.566818:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003526016 00000100:00100000:3.0:1787365268.566827:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003526016 00000100:00100000:3.0:1787365268.566879:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 189 00000100:00100000:3.0:1787365268.566889:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+24:11539:x1874188003526016:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1787365268.566918:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365268.568181:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb4793d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989892ce expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.568261:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47944 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.568276:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47944 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.568296:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47944 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.568312:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb4794b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.568319:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb4794b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.568327:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb4794b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.571052:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47952 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.571069:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.571080:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47952 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365268.571090:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:3.0:1787365268.571177:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47944 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.571184:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47944 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.571190:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47944 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.571195:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365268.572011:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47944 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.572021:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47944 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.572044:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:3.0:1787365268.572047:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365268.572052:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47944 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.572058:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47944 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.572073:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb4794b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.572079:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb4794b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.572085:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb4794b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.572090:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365268.572093:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb4794b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.572099:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb4794b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.572106:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f2789e48b00) 00010000:00010000:3.0:1787365268.572109:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365268.572120:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb4794b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.572126:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb4794b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.572178:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb4793d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ce expref: 27 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.572193:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47952 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ce expref: 26 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.572200:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f2789e48100) 00010000:00010000:3.0:1787365268.572203:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787365268.572205:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44400, rc 0) 00000100:00100000:3.0:1787365268.572272:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63b0a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+26:11539:x1874188003526016:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 5384us (5572us total) trans 4294967470 rc 0/0 00000100:00100000:3.0:1787365268.572281:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 189 00000100:00100000:1.0:1787365268.595315:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365268.595367:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003526144 00000100:00100000:1.0:1787365268.595376:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003526144 00000100:00100000:1.0:1787365268.595439:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 190 00000100:00100000:1.0:1787365268.595450:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+26:11539:x1874188003526144:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:1.0:1787365268.595511:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47960 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.595732:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.595745:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.595773:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47960 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.595780:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47960 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.595787:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.595793:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365268.595796:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47960 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.595804:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47960 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.595826:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f2789e48100) 00010000:00010000:1.0:1787365268.595829:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787365268.595847:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47960 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.595854:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47960 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365268.595919:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798026300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+26:11539:x1874188003526144:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 471us (611us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365268.596353:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 190 00000100:00100000:3.0:1787365268.605477:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365268.606231:0:11946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003526400 00000100:00100000:2.0:1787365268.606242:0:11946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003526400 00000100:00100000:2.0:1787365268.606294:0:11946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:2.0:1787365268.606304:0:11946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+26:11539:x1874188003526400:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1787365268.606522:0:11946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63b0700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+27:11539:x1874188003526400:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 219us (1053us total) trans 4294967471 rc 0/0 00000100:00100000:2.0:1787365268.608043:0:11946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:3.0:1787365268.675744:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365268.676789:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003526656 00000100:00100000:0.0:1787365268.676800:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003526656 00000100:00100000:0.0:1787365268.676864:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 191 00000100:00100000:0.0:1787365268.676875:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+27:11065:x1874188003526656:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1787365268.676899:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365268.676988:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb47967 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989892d5 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365268.677220:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4796e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365268.677234:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47952 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ce expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365268.677243:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4796e lrc: 4/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365268.677293:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47952 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ce expref: 28 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365268.677306:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47952 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ce expref: 28 pid: 5833 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365268.677319:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2788f8df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874188024493056:192.168.203.13@tcp:104: 00000100:00100000:0.0:1787365268.677507:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b64c6000 going to sleep for 11 seconds 00000100:00100000:3.0:1787365268.691836:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2788f8df80 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874188024493056:192.168.203.13@tcp:104: 00010000:00010000:3.0:1787365268.691867:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4796e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365268.692287:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365268.692357:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003526784 00000100:00100000:0.0:1787365268.692364:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003526784 00010000:00010000:0.0:1787365268.692400:0:8434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47952 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ce expref: 29 pid: 5833 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365268.692439:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:0.0:1787365268.692449:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+29:2362:x1874188003526784:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787365268.692464:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365268.692471:0:8434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47952 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ce expref: 29 pid: 5833 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365268.692483:0:8434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47952 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ce expref: 29 pid: 5833 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365268.692506:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47952 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ce expref: 29 pid: 5833 timeout: 485 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365268.692522:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f2789e48100) 00010000:00010000:0.0:1787365268.692547:0:8434:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4796e lrc: 3/0,1 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365268.692557:0:8434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4796e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365268.692565:0:8434:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4796e lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365268.692596:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365268.692682:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63b1f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+28:2362:x1874188003526784:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 234us (396us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365268.692690:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 72 00010000:00010000:1.0:1787365268.692867:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4796e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.692875:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4796e lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787365268.692891:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 9 00010000:00010000:1.0:1787365268.693056:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780031c00/0x872d29295eb47967 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892d5 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.693083:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4796e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892d5 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.693092:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f2789e48100) 00010000:00010000:1.0:1787365268.693094:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787365268.693097:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780030800, rc 0) 00000100:00100000:1.0:1787365268.693133:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63b0000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+28:11065:x1874188003526656:12345-192.168.203.13@tcp:101:bash.0 Request processed in 16261us (17397us total) trans 4294967472 rc 0/0 00000100:00100000:1.0:1787365268.693141:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 191 00000100:00100000:3.0:1787365268.697782:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365268.697891:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003527040 00000100:00100000:1.0:1787365268.697900:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003527040 00000100:00100000:1.0:1787365268.697978:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 192 00000100:00100000:1.0:1787365268.697988:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+28:11065:x1874188003527040:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:1.0:1787365268.698675:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb4797c lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.698695:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb4797c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.698706:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb4797c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787365268.698761:0:6704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967473 00000004:00010000:1.0:1787365268.698789:0:6704:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000067115cad reply state 00000000872c9aef transno 4294967474 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb4797c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365268.698797:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000001:00080000:1.0:1787365268.698844:0:6704:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967474 00000100:00100000:1.0:1787365268.699247:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63b2a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+32:11065:x1874188003527040:12345-192.168.203.13@tcp:36:bash.0 Request processed in 1257us (1472us total) trans 4294967475 rc 0/0 00000100:00100000:1.0:1787365268.699257:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 192 00000020:00080000:1.0:1787365268.699262:0:6704:0:(tgt_main.c:784:tgt_ses_key_exit()) total 3 transactions per RPC 00010000:00010000:3.0:1787365268.702519:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb4797c lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.702545:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb4797c lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.702568:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb4797c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.702575:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365268.702579:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb4797c lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.702588:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb4797c lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.702604:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f2789e48100) 00010000:00010000:3.0:1787365268.702608:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365268.702613:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb4797c lrc: 2/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.702620:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb4797c lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365268.703256:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365268.703443:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003527168 00000100:00100000:0.0:1787365268.703453:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003527168 00000100:00100000:0.0:1787365268.703508:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 193 00000100:00100000:0.0:1787365268.703518:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+31:11065:x1874188003527168:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1787365268.703540:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365268.703557:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47983 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989892dc expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365268.703617:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47983 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892dc expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365268.703655:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47983 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892dc expref: 32 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365268.703674:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f2789e48100) 00010000:00010000:0.0:1787365268.703677:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787365268.703690:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27c2045800, rc 0) 00000100:00100000:0.0:1787365268.703743:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63b2680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+32:11065:x1874188003527168:12345-192.168.203.13@tcp:101:bash.0 Request processed in 226us (492us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365268.703762:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 193 00000100:00100000:0.0:1787365268.709234:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365268.709335:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003527296 00000100:00100000:1.0:1787365268.709344:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003527296 00000100:00100000:1.0:1787365268.709415:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:1.0:1787365268.709425:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:11065:x1874188003527296:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:1.0:1787365268.709443:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365268.709463:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb4798a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989892e3 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787365268.709491:0:6681:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a890790, atime: 0x6a89078e, ctime: 0x6a890790, blocks: 0xb 00010000:00010000:1.0:1787365268.709539:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=385s v=(0 0) 00010000:00010000:1.0:1787365268.709545:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365268.709553:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb4798a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892e3 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.709574:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb4798a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892e3 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.709586:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798114200, rc 0) 00000100:00100000:1.0:1787365268.709670:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:11065:x1874188003527296:12345-192.168.203.13@tcp:101:bash.0 Request processed in 246us (445us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365268.709677:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00080000:0.0:1787365268.709746:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787365268.719260:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365268.720218:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003527424 00000100:00100000:1.0:1787365268.720230:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003527424 00002000:00010000:1.0:1787365268.720284:0:6688:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1787365268.720290:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f27b63b3800 with x1874188003527424 ext(0->18446744073709551615) 00002000:00010000:1.0:1787365268.720302:0:6688:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f27b63b3800. 00000100:00100000:1.0:1787365268.720335:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:1.0:1787365268.720353:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2361:x1874188003527424:12345-192.168.203.13@tcp:10:bash.0 00002000:00010000:1.0:1787365268.720911:0:6688:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb size from disk: 9 -> 0 00002000:00010000:1.0:1787365268.720915:0:6688:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb mtime from disk: 1787365264 -> 1787365268 00002000:00010000:1.0:1787365268.720918:0:6688:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb atime from disk: 1787365262 -> 1787365262 00002000:00010000:1.0:1787365268.720920:0:6688:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb ctime from disk: 1787365264 -> 1787365268 00002000:00010000:1.0:1787365268.720923:0:6688:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x5:0x0] updating lvb blocks from disk: 11 -> 11 00000100:00100000:1.0:1787365268.721055:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63b3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:2361:x1874188003527424:12345-192.168.203.13@tcp:10:bash.0 Request processed in 710us (1803us total) trans 4294967318 rc 0/0 00000100:00100000:1.0:1787365268.721082:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00002000:00010000:1.0:1787365268.721086:0:6688:0:(ofd_dev.c:2827:ofd_punch_hpreq_check()) lustre-OST0001: refresh locks: 10737419264/5 (0->18446744073709551615) 00002000:00100000:1.0:1787365268.721089:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f27b63b3800 with x1874188003527424 ext(0->18446744073709551615) 00002000:00010000:1.0:1787365268.721095:0:6688:0:(ofd_dev.c:2832:ofd_punch_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f27b63b3800. 00000100:00100000:0.0:1787365268.809185:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365268.809297:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003527552 00000100:00100000:1.0:1787365268.809307:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003527552 00000100:00100000:1.0:1787365268.809537:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 194 00000100:00100000:1.0:1787365268.809549:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+32:11553:x1874188003527552:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:1.0:1787365268.809621:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47991 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.809676:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47991 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.809688:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47991 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.809703:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb47998 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.809720:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb47998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.809727:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb47998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810046:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114e00/0x872d29295eb4799f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810057:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114e00/0x872d29295eb4799f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810073:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114e00/0x872d29295eb4799f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:1.0:1787365268.810114:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114e00/0x872d29295eb4799f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810127:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47991 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810134:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47991 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810141:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47991 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810147:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365268.810151:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47991 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810158:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47991 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810170:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:1.0:1787365268.810173:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365268.810178:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47991 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810185:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb47991 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810198:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb47998 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810211:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb47998 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810217:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb47998 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810223:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365268.810226:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb47998 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810232:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb47998 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810241:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f2784761000) 00010000:00010000:1.0:1787365268.810243:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365268.810246:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb47998 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810252:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114800/0x872d29295eb47998 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810267:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114e00/0x872d29295eb4799f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810273:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114e00/0x872d29295eb4799f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810279:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114e00/0x872d29295eb4799f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810284:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114e00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365268.810293:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114e00/0x872d29295eb4799f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810300:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114e00/0x872d29295eb4799f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810309:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f2789e48100) 00010000:00010000:1.0:1787365268.810312:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365268.810315:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114e00/0x872d29295eb4799f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.810322:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114e00/0x872d29295eb4799f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365268.810791:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+32:11553:x1874188003527552:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 1240us (1610us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365268.810802:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 194 00010000:00010000:1.0:1787365268.851362:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365268.863843:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365268.863889:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365268.863923:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365268.863958:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365268.863981:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365268.864180:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003527936 00000100:00100000:3.0:1787365268.864190:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003527936 00000100:00100000:3.0:1787365268.864251:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003528064 00000100:00100000:3.0:1787365268.864254:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003528064 00000100:00100000:3.0:1787365268.864274:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:3.0:1787365268.864284:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2362:x1874188003527936:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365268.864361:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2362:x1874188003527936:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 76us (470us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365268.864436:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:3.0:1787365268.864468:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:3.0:1787365268.864475:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:2362:x1874188003528064:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365268.864504:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb3800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:2362:x1874188003528064:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 29us (522us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365268.864510:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:2.0:1787365268.865044:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003528192 00000100:00100000:2.0:1787365268.865050:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003528192 00000100:00100000:2.0:1787365268.865088:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003527808 00000100:00100000:2.0:1787365268.865091:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003527808 00000100:00100000:2.0:1787365268.865113:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 168 00000100:00100000:2.0:1787365268.865121:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2362:x1874188003528192:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1787365268.865155:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2362:x1874188003528192:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 36us (1231us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365268.865161:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 168 00000100:00100000:2.0:1787365268.865175:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00100000:2.0:1787365268.865181:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+32:2362:x1874188003527808:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1787365268.865204:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+32:2362:x1874188003527808:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 23us (1246us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365268.865211:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 169 00000100:00100000:1.0:1787365268.865320:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003527680 00000100:00100000:1.0:1787365268.865324:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003527680 00000100:00100000:1.0:1787365268.865362:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 300 00000100:00100000:1.0:1787365268.865379:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2362:x1874188003527680:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365268.865405:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788e18450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2362:x1874188003527680:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 29us (1573us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365268.865411:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 300 00000100:00080000:0.0:1787365268.865919:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787365268.865924:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787365268.881941:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365268.882901:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003528448 00000100:00100000:2.0:1787365268.882914:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003528448 00000100:00100000:2.0:1787365268.882984:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 195 00000100:00100000:2.0:1787365268.882995:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+32:11556:x1874188003528448:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1787365268.883015:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365268.883046:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb479a6 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989892ea expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.883121:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb479ad lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.883135:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb479ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.883176:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb479ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.883192:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb479b4 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.883200:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb479b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.883206:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb479b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.886125:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb479bb lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.886145:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb479bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.887486:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb479bb lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365268.887510:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 0 00010000:00010000:2.0:1787365268.887645:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb479ad lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.887653:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb479ad lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.887660:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb479ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.887665:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365268.887681:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb479ad lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.887690:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb479ad lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.887702:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:2.0:1787365268.887706:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365268.887722:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb479ad lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.887730:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb479ad lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.888906:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb479b4 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.888923:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb479b4 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.888930:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb479b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.888936:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365268.888941:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb479b4 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.888949:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb479b4 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.888963:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f27988df900) 00010000:00010000:2.0:1787365268.888966:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365268.888982:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb479b4 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.888989:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb479b4 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.889068:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb479a6 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ea expref: 35 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.889085:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb479bb lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ea expref: 34 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365268.889092:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f2789e48100) 00010000:00010000:2.0:1787365268.889094:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787365268.889097:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb709000, rc 0) 00000100:00100000:2.0:1787365268.890804:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c46a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+34:11556:x1874188003528448:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 7801us (8863us total) trans 4294967476 rc 0/0 00000100:00100000:2.0:1787365268.890816:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 195 00000100:00100000:0.0:1787365268.912138:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365268.912391:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003528576 00000100:00100000:3.0:1787365268.912400:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003528576 00000100:00100000:3.0:1787365268.912460:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 196 00000100:00100000:3.0:1787365268.912470:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+34:11556:x1874188003528576:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:3.0:1787365268.912533:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb479c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.912550:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4796e lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892d5 expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.912558:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb479c9 lrc: 4/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.912590:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4796e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892d5 expref: 34 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.912604:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4796e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892d5 expref: 34 pid: 5835 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365268.912617:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874188024493184:192.168.203.13@tcp:104: 00000100:00100000:3.0:1787365268.913461:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b690bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787365268.915495:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63b2300 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874188024493184:192.168.203.13@tcp:104: 00010000:00010000:3.0:1787365268.915532:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb479c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365268.916049:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365268.916275:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003528832 00000100:00100000:3.0:1787365268.916283:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003528832 00000100:00100000:3.0:1787365268.916338:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:3.0:1787365268.916347:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+35:5597:x1874188003528832:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:3.0:1787365268.916708:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+36:5597:x1874188003528832:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 361us (659us total) trans 4294967477 rc 0/0 00000100:00100000:3.0:1787365268.916716:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:1.0:1787365268.924572:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365268.924691:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003528960 00000100:00100000:3.0:1787365268.924700:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003528960 00010000:00010000:3.0:1787365268.924744:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4796e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892d5 expref: 36 pid: 5835 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365268.924792:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:3.0:1787365268.924801:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+36:2361:x1874188003528960:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365268.924820:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365268.924828:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4796e lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892d5 expref: 36 pid: 5835 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.924840:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4796e lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892d5 expref: 36 pid: 5835 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.924870:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030800/0x872d29295eb4796e lrc: 0/0,0 mode: --/CW res: [0x200000401:0xb:0x0].0x0 bits 0x5/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892d5 expref: 36 pid: 5835 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.924906:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f2789e48100) 00010000:00010000:3.0:1787365268.924911:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb479c9 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.924921:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb479c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.924929:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb479c9 lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365268.924964:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365268.925044:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798027b80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+35:2361:x1874188003528960:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 243us (481us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365268.925053:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 73 00010000:00010000:1.0:1787365268.925457:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb479c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.925467:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb479c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.925504:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb479c9 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.925510:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb479c9 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.925516:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb479c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.925522:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365268.925526:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb479c9 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.925533:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb479c9 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.925542:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f2789e48100) 00010000:00010000:1.0:1787365268.925545:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787365268.925548:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb479c9 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365268.925554:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb479c9 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365268.925605:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb732300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+34:11556:x1874188003528576:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 13134us (13474us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365268.925612:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 196 00000100:00100000:1.0:1787365268.931933:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365268.932143:0:11946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003529216 00000100:00100000:2.0:1787365268.932250:0:11946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003529216 00000100:00100000:2.0:1787365268.932314:0:11946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:2.0:1787365268.932325:0:11946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+34:11556:x1874188003529216:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:2.0:1787365268.933687:0:11946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+35:11556:x1874188003529216:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 1359us (1758us total) trans 4294967478 rc 0/0 00000100:00100000:2.0:1787365268.933697:0:11946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:2.0:1787365269.096402:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365269.096502:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003529472 00000100:00100000:3.0:1787365269.096511:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003529472 00000100:00100000:3.0:1787365269.096569:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 197 00000100:00100000:3.0:1787365269.096579:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+35:11567:x1874188003529472:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:3.0:1787365269.096602:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365269.096665:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb479d0 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989892f1 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.096739:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb479d7 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.096767:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb479d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.096779:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb479d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.096809:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb479de lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.096818:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb479de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.096825:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb479de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.097166:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb479e5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.097177:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb479e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.097184:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb479e5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365269.097192:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xb:0x0]: returning size 8 00010000:00010000:3.0:1787365269.097273:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb479d7 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.097280:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb479d7 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.097286:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb479d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.097292:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365269.097296:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb479d7 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.097312:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb479d7 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.097324:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:3.0:1787365269.097327:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365269.097331:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb479d7 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.097336:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb479d7 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.097348:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb479de lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.097354:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb479de lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.097360:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb479de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.097364:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365269.097367:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb479de lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.097372:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb479de lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.097379:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f2789e48b00) 00010000:00010000:3.0:1787365269.097381:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365269.097384:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb479de lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.097399:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb479de lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.097437:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb479d0 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892f1 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.097449:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb479e5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892f1 expref: 37 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.097455:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f2789e48100) 00010000:00010000:3.0:1787365269.097458:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787365269.097460:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45600, rc 0) 00000100:00100000:3.0:1787365269.097522:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+37:11567:x1874188003529472:12345-192.168.203.13@tcp:101:cat.0 Request processed in 945us (1131us total) trans 4294967479 rc 0/0 00000100:00100000:3.0:1787365269.097530:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 197 00000100:00100000:0.0:1787365269.108817:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365269.109342:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003529728 00000100:00100000:1.0:1787365269.109352:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003529728 00000100:00100000:1.0:1787365269.109423:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:1.0:1787365269.109433:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+37:11567:x1874188003529728:12345-192.168.203.13@tcp:35:cat.0 00000100:00100000:1.0:1787365269.109687:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb733800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+38:11567:x1874188003529728:12345-192.168.203.13@tcp:35:cat.0 Request processed in 254us (878us total) trans 4294967480 rc 0/0 00000100:00100000:1.0:1787365269.109695:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 54 00000100:00100000:1.0:1787365269.138233:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365269.138340:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003529984 00000100:00100000:0.0:1787365269.138350:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003529984 00000100:00100000:0.0:1787365269.138411:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 198 00000100:00100000:0.0:1787365269.138421:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+38:11568:x1874188003529984:12345-192.168.203.13@tcp:36:rm.0 00010000:00010000:0.0:1787365269.138497:0:6704:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 3 locks, starting at 0 00010000:00010000:0.0:1787365269.138525:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb479e5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892f1 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.138546:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709000/0x872d29295eb479bb lrc: 0/0,0 mode: --/PR res: [0x200000401:0xb:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ea expref: 37 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.138574:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb47983 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xb:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892dc expref: 36 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.138586:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f2789e48100) 00010000:00010000:0.0:1787365269.138596:0:6704:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787365269.138618:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb479f3 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.138671:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb479f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.138683:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb479f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.138699:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb479fa lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.138706:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb479fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.138712:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb479fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.139005:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22400/0x872d29295eb47a01 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.139015:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22400/0x872d29295eb47a01 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.139165:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22400/0x872d29295eb47a01 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787365269.139796:0:6704:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].7, 64 off8712 00000004:00080000:0.0:1787365269.139806:0:6704:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 386304179852ns, next at 387304176927ns, rc = 0 00010000:00010000:0.0:1787365269.139862:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22600/0x872d29295eb47a08 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.139872:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22600/0x872d29295eb47a08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.139881:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22600/0x872d29295eb47a08 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.139887:0:6704:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22600/0x872d29295eb47a08 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.139894:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22600/0x872d29295eb47a08 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.139901:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22600/0x872d29295eb47a08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.139928:0:6704:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787365269.139946:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22400/0x872d29295eb47a01 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.139952:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22400/0x872d29295eb47a01 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.139958:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22400/0x872d29295eb47a01 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.139964:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e22400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365269.139974:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22400/0x872d29295eb47a01 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.139981:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22400/0x872d29295eb47a01 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.139991:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:0.0:1787365269.139994:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 3 00010000:00010000:0.0:1787365269.139998:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22400/0x872d29295eb47a01 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.140003:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22400/0x872d29295eb47a01 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xb:0x0].0x0 bits 0x3/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.140178:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365269.140185:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22600/0x872d29295eb47a08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.140193:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e22600 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365269.140196:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22600/0x872d29295eb47a08 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.140202:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22600/0x872d29295eb47a08 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.140212:0:5821:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xb:0x0].0x0 (ffff9f278a0ada00) 00010000:00010000:1.0:1787365269.140214:0:5821:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:1.0:1787365269.140217:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22600/0x872d29295eb47a08 lrc: 1/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.140221:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22600/0x872d29295eb47a08 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xb:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.140234:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365269.140236:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365269.140237:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365269.140723:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb479f3 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.140732:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb479f3 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.140739:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb479f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.140744:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2045400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365269.140747:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb479f3 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.140753:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb479f3 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.140762:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:0.0:1787365269.140764:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365269.140776:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb479f3 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.140781:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb479f3 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:0.0:1787365269.140794:0:6704:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000597217b2 reply state 0000000063d4635e transno 4294967481 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb479fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365269.140803:0:6704:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:0.0:1787365269.140922:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798026d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+37:11568:x1874188003529984:12345-192.168.203.13@tcp:36:rm.0 Request processed in 2499us (2695us total) trans 4294967481 rc 0/0 00000100:00100000:0.0:1787365269.140931:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 198 00010000:00010000:3.0:1787365269.148819:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb479fa lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.148837:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb479fa lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.148845:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb479fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.148851:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2045a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365269.148855:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb479fa lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.148862:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb479fa lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.148896:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f278a0ad800) 00010000:00010000:3.0:1787365269.148900:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365269.148905:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb479fa lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.148911:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb479fa lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365269.227709:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365269.227994:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003530240 00000100:00100000:3.0:1787365269.228003:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003530240 00000100:00100000:3.0:1787365269.228069:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 199 00000100:00100000:3.0:1787365269.228081:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+36:11574:x1874188003530240:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1787365269.228103:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365269.228133:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47a0f lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989892f8 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.228260:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a16 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.228287:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.228300:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.228316:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47a1d lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.228323:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47a1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.228345:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47a1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787365269.228888:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0000-osc-MDT0000: Wrote last used FID: [0x240000400:0x5:0x0], index 0: 0 00010000:00010000:3.0:1787365269.229058:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47a24 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.229067:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47a24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.229075:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47a24 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.229107:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a16 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.229115:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a16 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.229121:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.229127:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365269.229131:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a16 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.229138:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a16 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.229150:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:3.0:1787365269.229153:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365269.229164:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a16 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.229170:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a16 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787365269.229183:0:5834:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000f2a5b107 reply state 00000000c7a065ab transno 4294967482 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47a1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365269.229191:0:5834:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787365269.229219:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47a0f lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892f8 expref: 39 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.229232:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47a24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892f8 expref: 38 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.229240:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2789e48200) 00010000:00010000:3.0:1787365269.229242:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787365269.229245:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45e00, rc 0) 00000100:00100000:3.0:1787365269.229306:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798025c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+39:11574:x1874188003530240:12345-192.168.203.13@tcp:101:bash.0 Request processed in 1228us (1606us total) trans 4294967482 rc 0/0 00000100:00100000:3.0:1787365269.229314:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 199 00000100:00100000:1.0:1787365269.237308:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365269.237410:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003530368 00000100:00100000:0.0:1787365269.237418:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003530368 00000100:00100000:0.0:1787365269.237487:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:0.0:1787365269.237498:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2361:x1874188003530368:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1787365269.237515:0:10260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365269.237535:0:10260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000338762c3/0x872d29295eb47a32 lrc: 2/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989892ff expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787365269.237562:0:10260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365269.237581:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=386s v=(0 0) 00010000:00010000:0.0:1787365269.237586:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365269.237595:0:10260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000338762c3/0x872d29295eb47a32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ff expref: 6 pid: 10260 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.237614:0:10260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 00000000338762c3/0x872d29295eb47a32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ff expref: 6 pid: 10260 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.237659:0:10260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27b6e22e00, rc 0) 00000100:00100000:0.0:1787365269.237712:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798027480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2361:x1874188003530368:12345-192.168.203.13@tcp:101:bash.0 Request processed in 216us (412us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365269.237719:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00010000:00010000:3.0:1787365269.238200:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47a1d lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.238210:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47a1d lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.238217:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47a1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.238235:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365269.238240:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47a1d lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.238247:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47a1d lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.238261:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f2789e48b00) 00010000:00010000:3.0:1787365269.238264:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365269.238278:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47a1d lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.238286:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47a1d lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365269.242187:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365269.242282:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003530496 00000100:00100000:0.0:1787365269.242292:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003530496 00000100:00100000:0.0:1787365269.242348:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:0.0:1787365269.242358:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:11574:x1874188003530496:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1787365269.242376:0:6682:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365269.242394:0:6682:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000003d24f75f/0x872d29295eb47a39 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989306 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.242423:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 00000000338762c3/0x872d29295eb47a32 lrc: 2/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ff expref: 7 pid: 10260 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.242433:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365269.242437:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365269.242443:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d24f75f/0x872d29295eb47a39 lrc: 4/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989306 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.242475:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 00000000338762c3/0x872d29295eb47a32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ff expref: 7 pid: 10260 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.242490:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 00000000338762c3/0x872d29295eb47a32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ff expref: 7 pid: 10260 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365269.242519:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb730a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1874188024493312:192.168.203.13@tcp:104: 00000100:00100000:0.0:1787365269.242613:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b64c6a80 going to sleep for 11 seconds 00000100:00100000:2.0:1787365269.249345:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb730a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0000_UUID:6682:1874188024493312:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365269.249396:0:6682:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0000_UUID lock: 000000003d24f75f/0x872d29295eb47a39 lrc: 3/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989306 expref: 7 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.249418:0:6682:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27b6e22800, rc 0) 00000100:00100000:2.0:1787365269.249476:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:11574:x1874188003530496:12345-192.168.203.13@tcp:101:bash.0 Request processed in 7119us (7297us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365269.249485:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:0.0:1787365269.249725:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365269.249938:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003530624 00000100:00100000:1.0:1787365269.249946:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003530624 00010000:00010000:1.0:1787365269.249978:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 00000000338762c3/0x872d29295eb47a32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ff expref: 7 pid: 10260 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365269.250014:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:1.0:1787365269.250033:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb730a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2362:x1874188003530624:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365269.250047:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365269.250068:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 00000000338762c3/0x872d29295eb47a32 lrc: 4/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ff expref: 7 pid: 10260 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.250080:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 00000000338762c3/0x872d29295eb47a32 lrc: 3/0,0 mode: PR/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ff expref: 7 pid: 10260 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.250101:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000338762c3/0x872d29295eb47a32 lrc: 0/0,0 mode: --/PR res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892ff expref: 7 pid: 10260 timeout: 486 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.250115:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365269.250119:0:5820:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365269.250127:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 000000003d24f75f/0x872d29295eb47a39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989306 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.250138:0:5820:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000003d24f75f/0x872d29295eb47a39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989306 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.250170:0:5820:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0000_UUID lock: 000000003d24f75f/0x872d29295eb47a39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989306 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365269.250193:0:5820:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2798024000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5820:1874188024493440:192.168.203.13@tcp:105: 00000100:00100000:1.0:1787365269.250243:0:5820:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2686c77000 going to sleep for 11 seconds 00000100:00100000:2.0:1787365269.254587:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365269.254854:0:5820:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2798024000 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_002:lustre-OST0000_UUID:5820:1874188024493440:192.168.203.13@tcp:105: 00010000:00010000:1.0:1787365269.254878:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365269.254930:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb730a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2362:x1874188003530624:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 4907us (5205us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365269.254941:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 74 00000100:00100000:3.0:1787365269.255018:0:11946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003530880 00000100:00100000:3.0:1787365269.255034:0:11946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003530880 00000100:00100000:3.0:1787365269.255080:0:11946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:3.0:1787365269.255089:0:11946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbadb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+38:11574:x1874188003530880:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:3.0:1787365269.257195:0:11946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbadb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+39:11574:x1874188003530880:12345-192.168.203.13@tcp:35:bash.0 Request processed in 2097us (2609us total) trans 4294967483 rc 0/0 00000100:00100000:3.0:1787365269.257206:0:11946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 55 00000100:00100000:1.0:1787365269.363585:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbadb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024493568:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787365269.363683:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365269.367030:0:6683:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024493568 00000100:00100000:0.0:1787365269.367046:0:6683:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024493568 00000100:00100000:0.0:1787365269.367139:0:6683:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:0.0:1787365269.367149:0:6683:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874188024493568:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787365269.367184:0:6683:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 49348608 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787365269.367278:0:6683:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798024000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874188024493568:12345-0@lo:13:osp-pre-0-0.0 Request processed in 130us (3593us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365269.367286:0:6683:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:3.0:1787365269.367348:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbadb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024493568:0@lo:13:osp-pre-0-0.0 00000100:00080000:1.0:1787365269.367416:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787365269.469345:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365269.469454:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003531008 00000100:00100000:1.0:1787365269.469464:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003531008 00000100:00100000:1.0:1787365269.469580:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00100000:1.0:1787365269.469592:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+39:11590:x1874188003531008:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1787365269.469616:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365269.469670:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb47a40 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898930d expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.469739:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb47a47 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.469764:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb47a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.469775:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb47a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787365269.469851:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:1.0:1787365269.470478:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:1.0:1787365269.470515:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb47a47 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.470543:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114c00/0x872d29295eb47a40 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898930d expref: 41 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.470560:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb47a47 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898930d expref: 40 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.470568:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:1.0:1787365269.470571:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787365269.470574:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115c00, rc 0) 00000100:00100000:1.0:1787365269.470688:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+40:11590:x1874188003531008:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1096us (1349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365269.470696:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 200 00000100:00100000:3.0:1787365269.475768:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365269.481084:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003531264 00000100:00100000:0.0:1787365269.481098:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003531264 00000100:00100000:3.0:1787365269.481734:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 201 00000100:00100000:3.0:1787365269.481756:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+40:11590:x1874188003531264:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1787365269.481789:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365269.481808:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47a4e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989314 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.482098:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47a55 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.482111:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47a55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.482121:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47a55 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365269.482130:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787365269.482248:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47a4e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989314 expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.482266:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47a55 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989314 expref: 42 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.482275:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2789e48200) 00010000:00010000:3.0:1787365269.482278:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787365269.482282:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45200, rc 0) 00000100:00100000:3.0:1787365269.482344:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63b2300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+42:11590:x1874188003531264:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 602us (6585us total) trans 4294967484 rc 0/0 00000100:00100000:3.0:1787365269.482351:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 201 00000100:00100000:2.0:1787365269.486036:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365269.486082:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365269.486171:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003531392 00000100:00100000:1.0:1787365269.486181:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003531392 00000100:00100000:1.0:1787365269.486244:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:1.0:1787365269.486254:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27882b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+42:2362:x1874188003531392:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365269.486270:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365269.486295:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb47a55 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989314 expref: 42 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.486312:0:5819:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2789e48200) 00010000:00010000:1.0:1787365269.486328:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365269.486382:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27882b8050 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+41:2362:x1874188003531392:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 130us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365269.486390:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:3.0:1787365269.489067:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003531648 00000100:00100000:3.0:1787365269.489083:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003531648 00000100:00100000:3.0:1787365269.489146:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 202 00000100:00100000:3.0:1787365269.489170:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+41:11590:x1874188003531648:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1787365269.489196:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365269.489215:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a63 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898931b expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.489313:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb47a6a lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.489327:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb47a6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.489337:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb47a6a lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365269.489350:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787365269.489467:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a63 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898931b expref: 44 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.489485:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb47a6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898931b expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.489493:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2789e48200) 00010000:00010000:3.0:1787365269.489495:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:3.0:1787365269.489498:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45600, rc 0) 00000100:00100000:3.0:1787365269.489564:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+43:11590:x1874188003531648:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 396us (3546us total) trans 4294967485 rc 0/0 00000100:00100000:3.0:1787365269.489572:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 202 00000100:00100000:2.0:1787365269.504181:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365269.504274:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003531776 00000100:00100000:0.0:1787365269.504284:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003531776 00000100:00100000:0.0:1787365269.504347:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:0.0:1787365269.504357:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+6:2361:x1874188003531776:12345-192.168.203.13@tcp:1:lfs.0 00010000:00010000:0.0:1787365269.504401:0:10260:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3df4676/0x872d29295eb47a78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.504421:0:10260:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0000_UUID lock: 000000003d24f75f/0x872d29295eb47a39 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989306 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.504430:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365269.504434:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787365269.504452:0:10260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3df4676/0x872d29295eb47a78 lrc: 4/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.504487:0:10260:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0000_UUID lock: 000000003d24f75f/0x872d29295eb47a39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989306 expref: 6 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.504500:0:10260:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0000_UUID lock: 000000003d24f75f/0x872d29295eb47a39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989306 expref: 6 pid: 6682 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365269.504514:0:10260:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb730a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10260:1874188024493696:192.168.203.13@tcp:104: 00000100:00100000:0.0:1787365269.504602:0:10260:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b64c6000 going to sleep for 11 seconds 00000100:00100000:2.0:1787365269.509863:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365269.510053:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003531904 00000100:00100000:3.0:1787365269.510063:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003531904 00002000:00100000:3.0:1787365269.510125:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9f27bbad8000 x1874188003531904/t0(0) o4->8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp:175/0 lens 504/0 e 0 to 0 dl 1787365280 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787365269.510136:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f27bbad8000 with x1874188003531904 ext(0->8) 00010000:00010000:3.0:1787365269.510148:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003d24f75f/0x872d29295eb47a39 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989306 expref: 7 pid: 6682 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.510162:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003d24f75f/0x872d29295eb47a39 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989306 expref: 7 pid: 6682 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787365269.510169:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9f27bbad8000 00000100:00100000:3.0:1787365269.510204:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:3.0:1787365269.510213:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2362:x1874188003531904:12345-192.168.203.13@tcp:4:lfs.0 00000100:00100000:3.0:1787365269.511115:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad8000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:2362:x1874188003531904:12345-192.168.203.13@tcp:4:lfs.0 Request processed in 601us (970us total) trans 4294967308 rc 0/0 00000100:00100000:3.0:1787365269.511127:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00002000:00100000:3.0:1787365269.511425:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0000 ll_ost_io00_000: refresh rw locks for [0x240000400:0x5:0x0] (0->8) req@ffff9f27bbad8000 x1874188003531904/t4294967308(0) o4->8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp:175/0 lens 504/448 e 0 to 0 dl 1787365280 ref 1 fl Complete:H/600/0 rc 0/0 job:'lfs.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787365269.511436:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f27bbad8000 with x1874188003531904 ext(0->8) 00010000:00010000:3.0:1787365269.511445:0:6686:0:(ldlm_extent.c:791:ldlm_lock_prolong_one()) ### refreshed to 100s. ns: filter-lustre-OST0000_UUID lock: 000000003d24f75f/0x872d29295eb47a39 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989306 expref: 9 pid: 6682 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.511462:0:6686:0:(ldlm_lockd.c:607:ldlm_refresh_waiting_lock()) ### refreshed to 100s ns: filter-lustre-OST0000_UUID lock: 000000003d24f75f/0x872d29295eb47a39 lrc: 5/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989306 expref: 9 pid: 6682 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787365269.511469:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0000: refreshed 1 locks timeout for req ffff9f27bbad8000 00000100:00100000:0.0:1787365269.513117:0:10260:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb730a80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_003:lustre-OST0000_UUID:10260:1874188024493696:192.168.203.13@tcp:104: 00010000:00010000:0.0:1787365269.513146:0:10260:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0000_UUID lock: 00000000f3df4676/0x872d29295eb47a78 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365269.519201:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365269.520173:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003532032 00000100:00100000:0.0:1787365269.520184:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003532032 00010000:00010000:0.0:1787365269.520231:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0000_UUID lock: 000000003d24f75f/0x872d29295eb47a39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989306 expref: 9 pid: 6682 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365269.520281:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 75 00000100:00100000:0.0:1787365269.520292:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbadb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:2361:x1874188003532032:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787365269.520307:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00002000:00010000:0.0:1787365269.520325:0:8435:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb size from disk: 0 -> 9 00002000:00010000:0.0:1787365269.520328:0:8435:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb mtime from disk: 0 -> 1787365268 00002000:00010000:0.0:1787365269.520331:0:8435:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb atime from disk: 0 -> 1787365268 00002000:00010000:0.0:1787365269.520346:0:8435:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x240000400:0x5:0x0] updating lvb ctime from disk: 0 -> 1787365268 00010000:00010000:0.0:1787365269.520352:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0000_UUID lock: 000000003d24f75f/0x872d29295eb47a39 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989306 expref: 9 pid: 6682 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.520367:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0000_UUID lock: 000000003d24f75f/0x872d29295eb47a39 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989306 expref: 9 pid: 6682 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.520391:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000003d24f75f/0x872d29295eb47a39 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989306 expref: 9 pid: 6682 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.520407:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787365269.520411:0:8435:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787365269.520418:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0000_UUID lock: 00000000f3df4676/0x872d29295eb47a78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.520430:0:8435:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f3df4676/0x872d29295eb47a78 lrc: 4/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.520468:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365269.520708:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbadb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2361:x1874188003532032:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 417us (1514us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365269.520718:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 75 00010000:00010000:3.0:1787365269.522190:0:10260:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0000_UUID lock: 00000000f3df4676/0x872d29295eb47a78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.522208:0:10260:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f3df4676/0x872d29295eb47a78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.522246:0:10260:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f3df4676/0x872d29295eb47a78 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.522255:0:10260:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f3df4676/0x872d29295eb47a78 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.522264:0:10260:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f3df4676/0x872d29295eb47a78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.522272:0:10260:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e22c00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365269.522277:0:10260:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3df4676/0x872d29295eb47a78 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.522287:0:10260:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f3df4676/0x872d29295eb47a78 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.522306:0:10260:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f3df4676/0x872d29295eb47a78 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.522314:0:10260:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f3df4676/0x872d29295eb47a78 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365269.522414:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2361:x1874188003531776:12345-192.168.203.13@tcp:1:lfs.0 Request processed in 18056us (18240us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365269.522425:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:2.0:1787365269.529273:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365269.529426:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003532288 00000100:00100000:3.0:1787365269.529436:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003532288 00000100:00100000:3.0:1787365269.529542:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 56 00000100:00100000:3.0:1787365269.529554:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278ac6f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+43:11590:x1874188003532288:12345-192.168.203.13@tcp:35:lfs.0 00000004:00010000:3.0:1787365269.529661:0:5836:0:(mdt_open.c:1998:mdt_hsm_release()) ### [0x200000401:0xe:0x0] lease broken? 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb47a6a lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898931b expref: 43 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787365269.529937:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967486 00000001:00080000:3.0:1787365269.529984:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967487 00000001:00080000:3.0:1787365269.530283:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967488 00010000:00010000:3.0:1787365269.530348:0:5836:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a7f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.530363:0:5836:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47a24 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892f8 expref: 47 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.530373:0:5836:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a7f lrc: 4/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.530405:0:5836:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47a24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892f8 expref: 47 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.530419:0:5836:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47a24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892f8 expref: 47 pid: 5834 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365269.530446:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63b3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1874188024493824:192.168.203.13@tcp:104: 00000100:00100000:3.0:1787365269.530515:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b690bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787365269.537751:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63b3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000_UUID:5836:1874188024493824:192.168.203.13@tcp:104: 00010000:00010000:3.0:1787365269.537781:0:5836:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a7f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365269.538221:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365269.538867:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003532416 00000100:00100000:1.0:1787365269.538875:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003532416 00010000:00010000:1.0:1787365269.538913:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47a24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892f8 expref: 48 pid: 5834 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365269.538956:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:1.0:1787365269.538967:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+48:2362:x1874188003532416:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365269.538982:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365269.538988:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47a24 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892f8 expref: 48 pid: 5834 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.539001:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47a24 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892f8 expref: 48 pid: 5834 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.539034:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb47a24 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892f8 expref: 48 pid: 5834 timeout: 486 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.539050:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2789e48200) 00010000:00010000:1.0:1787365269.539055:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a7f lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.539065:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.539074:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a7f lrc: 4/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.539111:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365269.539164:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b67100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+47:2362:x1874188003532416:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 198us (943us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365269.539172:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 76 00010000:00010000:3.0:1787365269.539203:0:5836:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.539213:0:5836:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787365269.539330:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967489 00000001:00080000:3.0:1787365269.539540:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967490 00000100:00100000:3.0:1787365269.539710:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63b3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1874188024493952:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:3.0:1787365269.539773:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365269.539801:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b66d9000 going to sleep for 11 seconds 00000100:00100000:1.0:1787365269.541730:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024493952 00000100:00100000:1.0:1787365269.541744:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024493952 00000100:00100000:1.0:1787365269.541821:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787365269.541830:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1874188024493952:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787365269.541945:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63b1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1874188024493952:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 116us (2171us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365269.541952:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787365269.543366:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63b3b80 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1874188024493952:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787365269.546241:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967491 00000100:00100000:2.0:1787365269.546333:0:5836:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6b67480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1874188024494080:0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:2.0:1787365269.546477:0:5836:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365269.546510:0:5836:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473f540 going to sleep for 11 seconds 00000100:00100000:1.0:1787365269.547394:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024494080 00000100:00100000:1.0:1787365269.547404:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024494080 00000100:00100000:1.0:1787365269.547456:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:1.0:1787365269.547466:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5836:x1874188024494080:12345-0@lo:1000:mdt_rdpg00_000.0 00000100:00100000:1.0:1787365269.547709:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b65880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5836:x1874188024494080:12345-0@lo:1000:mdt_rdpg00_000.0 Request processed in 244us (1230us total) trans 4294967309 rc 0/0 00000100:00100000:1.0:1787365269.547718:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787365269.551807:0:5836:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6b67480 pname:cluuid:pid:xid:nid:opc:job mdt_rdpg00_000:lustre-MDT0000-mdtlov_UUID:5836:1874188024494080:0@lo:1000:mdt_rdpg00_000.0 00000001:00080000:2.0:1787365269.551916:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967492 00010000:00010000:2.0:1787365269.551976:0:5836:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a7f lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.551986:0:5836:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a7f lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.552011:0:5836:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.552016:0:5836:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365269.552056:0:5836:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a7f lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.552065:0:5836:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a7f lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.552079:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2789e48200) 00010000:00010000:2.0:1787365269.552082:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 28 00010000:00010000:2.0:1787365269.552086:0:5836:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a7f lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.552093:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45c00/0x872d29295eb47a7f lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x28/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5836 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787365269.552307:0:5836:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0xf:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000040:00080000:2.0:1787365269.552410:0:5836:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x3:0x0].5, 64 off8512 00000004:00080000:2.0:1787365269.552422:0:5836:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 386716795590ns, next at 387716793294ns, rc = 0 00000001:00080000:2.0:1787365269.552428:0:5836:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967493 00010000:00010000:2.0:1787365269.552459:0:5836:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2789e48200) 00010000:00010000:2.0:1787365269.552462:0:5836:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 4 00010000:00010000:2.0:1787365269.552468:0:5836:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45600/0x872d29295eb47a6a lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x4/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898931b expref: 51 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365269.552586:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278ac6f850 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+50:11590:x1874188003532288:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 23033us (23320us total) trans 4294967494 rc 0/0 00000100:00100000:2.0:1787365269.552606:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 56 00000020:00080000:2.0:1787365269.552613:0:5836:0:(tgt_main.c:784:tgt_ses_key_exit()) total 9 transactions per RPC 00000100:00100000:2.0:1787365269.563832:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365269.563956:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003532544 00000100:00100000:1.0:1787365269.563965:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003532544 00000100:00100000:1.0:1787365269.564038:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 203 00000100:00100000:1.0:1787365269.564050:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+50:11590:x1874188003532544:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:1.0:1787365269.564076:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365269.564099:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb47a86 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989322 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.564180:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb47a86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989322 expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.564196:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb47a86 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989322 expref: 51 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.564216:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:1.0:1787365269.564220:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:1.0:1787365269.564223:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798114a00, rc 0) 00000100:00100000:1.0:1787365269.564340:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b65180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+51:11590:x1874188003532544:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 293us (515us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365269.564347:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 203 00000100:00100000:1.0:1787365269.575917:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365269.576209:0:11946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003532800 00000100:00100000:3.0:1787365269.576218:0:11946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003532800 00000100:00100000:3.0:1787365269.576277:0:11946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:3.0:1787365269.576286:0:11946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+51:11590:x1874188003532800:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1787365269.576519:0:11946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798027800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+52:11590:x1874188003532800:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 233us (611us total) trans 4294967495 rc 0/0 00000100:00100000:3.0:1787365269.576527:0:11946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 57 00000100:00100000:2.0:1787365269.718388:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365269.718585:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003532928 00000100:00100000:3.0:1787365269.718594:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003532928 00000100:00100000:2.0:1787365269.719327:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 204 00000100:00100000:2.0:1787365269.719342:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+52:11600:x1874188003532928:12345-192.168.203.13@tcp:34:lfs.0 00010000:00010000:2.0:1787365269.719416:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47a8d lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.719434:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47a8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.719447:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47a8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.719461:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47a94 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.719467:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47a94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.719474:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47a94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.719563:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47a9b lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.719571:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47a9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.719578:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47a9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787365269.719650:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47a9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.719679:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47a8d lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.719686:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47a8d lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.719691:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47a8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.719696:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365269.719700:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47a8d lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.719706:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47a8d lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.719717:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:2.0:1787365269.719719:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365269.719723:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47a8d lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.719728:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47a8d lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.719750:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47a94 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.719756:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47a94 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.721168:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47a94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.721174:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365269.721178:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47a94 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.721186:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47a94 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.721201:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f27988df900) 00010000:00010000:2.0:1787365269.721204:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365269.721209:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47a94 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.721215:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47a94 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.721237:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47a9b lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.721244:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47a9b lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.721250:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47a9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.721255:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365269.721258:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47a9b lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.721277:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47a9b lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.721287:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:2.0:1787365269.721289:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365269.721304:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47a9b lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365269.721311:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47a9b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365269.721406:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b64e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+52:11600:x1874188003532928:12345-192.168.203.13@tcp:34:lfs.0 Request processed in 2065us (3023us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365269.721416:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 204 00000100:00100000:2.0:1787365269.791848:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365269.791943:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003533184 00000100:00100000:3.0:1787365269.791953:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003533184 00000100:00100000:3.0:1787365269.792015:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 205 00000100:00100000:3.0:1787365269.792034:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+52:11603:x1874188003533184:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1787365269.792055:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365269.792083:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47aa2 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989329 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.792160:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47aa9 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.792175:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47aa9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.792186:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47aa9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.792202:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47ab0 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.792210:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.792216:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.792345:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb47ab7 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.792354:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb47ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.792386:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb47ab7 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365269.792397:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787365269.792498:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47aa9 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.792996:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47aa9 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.793006:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47aa9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.793012:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365269.793017:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47aa9 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.793036:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47aa9 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.793049:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:3.0:1787365269.793052:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365269.793057:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47aa9 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.793063:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47aa9 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.793141:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47ab0 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.793147:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47ab0 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.793162:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.793166:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365269.793169:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47ab0 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.793175:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47ab0 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.793183:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f2789e48b00) 00010000:00010000:3.0:1787365269.793186:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365269.793189:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47ab0 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.793193:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47ab0 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.793425:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47aa2 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989329 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.793500:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb47ab7 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989329 expref: 54 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.793563:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:3.0:1787365269.793565:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787365269.793568:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45000, rc 0) 00000100:00100000:3.0:1787365269.793702:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b64a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+54:11603:x1874188003533184:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1669us (1862us total) trans 4294967496 rc 0/0 00000100:00100000:3.0:1787365269.793718:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 205 00000100:00100000:1.0:1787365269.798394:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365269.798664:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003533312 00000100:00100000:0.0:1787365269.798674:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003533312 00000100:00100000:0.0:1787365269.798731:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 206 00000100:00100000:0.0:1787365269.798741:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+54:11603:x1874188003533312:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:0.0:1787365269.798817:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22800/0x872d29295eb47ac5 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.798848:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22800/0x872d29295eb47ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.798862:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22800/0x872d29295eb47ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.798888:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22800/0x872d29295eb47ac5 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.798895:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22800/0x872d29295eb47ac5 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.798913:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22800/0x872d29295eb47ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.798921:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e22800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365269.798925:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22800/0x872d29295eb47ac5 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.798934:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22800/0x872d29295eb47ac5 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.798945:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:0.0:1787365269.798949:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:0.0:1787365269.798953:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22800/0x872d29295eb47ac5 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365269.798961:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22800/0x872d29295eb47ac5 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365269.799044:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798027b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+54:11603:x1874188003533312:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 304us (658us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365269.799059:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 206 00000100:00100000:2.0:1787365269.815257:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365269.815354:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003533568 00000100:00100000:0.0:1787365269.815364:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003533568 00000100:00100000:0.0:1787365269.815422:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 58 00000100:00100000:0.0:1787365269.815432:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+54:11603:x1874188003533568:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1787365269.815714:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+55:11603:x1874188003533568:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 282us (464us total) trans 4294967497 rc 0/0 00000100:00100000:0.0:1787365269.815721:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 58 00010000:00010000:1.0:1787365269.874846:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365269.968087:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365269.968123:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003533824 00000100:00100000:3.0:1787365269.968132:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003533824 00000100:00100000:3.0:1787365269.968410:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 207 00000100:00100000:3.0:1787365269.968419:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+55:11613:x1874188003533824:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1787365269.968444:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365269.968446:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:3.0:1787365269.968472:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115c00/0x872d29295eb47a47 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898930d expref: 55 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.968491:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:3.0:1787365269.968496:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787365269.968509:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47acc lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989330 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.968595:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47ad3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.968607:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.968617:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47ad3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365269.968659:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 9 00010000:00010000:3.0:1787365269.968763:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47acc lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989330 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.968796:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47ad3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989330 expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.968803:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:3.0:1787365269.968806:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787365269.968809:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44400, rc 0) 00000100:00100000:3.0:1787365269.968874:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63b2d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+56:11613:x1874188003533824:12345-192.168.203.13@tcp:101:bash.0 Request processed in 455us (796us total) trans 4294967498 rc 0/0 00000100:00100000:3.0:1787365269.968881:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 207 00000100:00100000:1.0:1787365269.973986:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365269.974342:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003534080 00000100:00100000:0.0:1787365269.974354:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003534080 00000100:00100000:1.0:1787365269.974453:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 208 00000100:00100000:1.0:1787365269.974537:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+56:11613:x1874188003534080:12345-192.168.203.13@tcp:36:bash.0 00010000:00010000:1.0:1787365269.974593:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 0 00010000:00010000:1.0:1787365269.974619:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb47ad3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989330 expref: 56 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.974736:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb47ab7 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989329 expref: 55 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.974763:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:1.0:1787365269.974769:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787365269.977506:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb47ae1 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.977529:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb47ae1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365269.977540:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb47ae1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787365269.977611:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967499 00000004:00010000:1.0:1787365269.977655:0:5833:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000899f1fd8 reply state 000000000258cf43 transno 4294967500 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb47ae1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365269.977664:0:5833:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:1.0:1787365269.977784:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798025500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+57:11613:x1874188003534080:12345-192.168.203.13@tcp:36:bash.0 Request processed in 3317us (3801us total) trans 4294967500 rc 0/0 00000100:00100000:1.0:1787365269.977793:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 208 00000020:00080000:1.0:1787365269.977798:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787365269.983434:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb47ae1 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.983450:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb47ae1 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.983457:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb47ae1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.983463:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798115200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365269.983467:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb47ae1 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.983474:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb47ae1 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.983490:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:3.0:1787365269.983493:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365269.983497:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb47ae1 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.983512:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115200/0x872d29295eb47ae1 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365269.987392:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365269.987584:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003534208 00000100:00100000:3.0:1787365269.987592:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003534208 00000100:00100000:3.0:1787365269.987892:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:3.0:1787365269.987903:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+56:11613:x1874188003534208:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1787365269.987926:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365269.987945:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47ae8 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989337 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.988014:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47aef lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.988040:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.988051:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365269.988076:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787365269.988080:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787365269.988095:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47aef lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.988118:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47ae8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989337 expref: 58 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.988133:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47aef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989337 expref: 57 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365269.988149:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:3.0:1787365269.988153:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787365269.988156:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44800, rc 0) 00000100:00100000:3.0:1787365269.988346:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+57:11613:x1874188003534208:12345-192.168.203.13@tcp:101:bash.0 Request processed in 444us (962us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365269.988353:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 209 00000100:00100000:3.0:1787365269.992819:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365269.993067:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003534464 00000100:00100000:1.0:1787365269.993077:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003534464 00000100:00100000:1.0:1787365269.993141:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 59 00000100:00100000:1.0:1787365269.993152:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+57:11613:x1874188003534464:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:1.0:1787365269.993374:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63b1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+58:11613:x1874188003534464:12345-192.168.203.13@tcp:35:bash.0 Request processed in 223us (561us total) trans 4294967501 rc 0/0 00000100:00100000:1.0:1787365269.993383:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 59 00000001:00080000:1.0:1787365270.024553:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967309 is committed 00000001:00080000:1.0:1787365270.024572:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967308 is committed 00000100:00100000:1.0:1787365270.073510:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365270.073612:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003534592 00000100:00100000:0.0:1787365270.073622:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003534592 00000100:00100000:0.0:1787365270.073737:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00100000:0.0:1787365270.073756:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+58:11619:x1874188003534592:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1787365270.073782:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365270.073802:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23000/0x872d29295eb47af6 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898933e expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.073864:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23200/0x872d29295eb47afd lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.073878:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23200/0x872d29295eb47afd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.073902:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23200/0x872d29295eb47afd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365270.073960:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xa:0x0]: returning size 7680 00000004:00200000:0.0:1787365270.073973:0:6704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 1 stripe count 1 MDT count 1 00000004:00010000:0.0:1787365270.074008:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23200/0x872d29295eb47afd lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.074042:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23000/0x872d29295eb47af6 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898933e expref: 60 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.074061:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23200/0x872d29295eb47afd lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898933e expref: 59 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.074069:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:0.0:1787365270.074072:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787365270.074076:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27b6e23200, rc 0) 00000100:00100000:0.0:1787365270.074134:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb408e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+59:11619:x1874188003534592:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 389us (635us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365270.074141:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 210 00000100:00080000:1.0:1787365270.075156:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365270.083460:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365270.083542:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003534720 00000100:00100000:3.0:1787365270.083551:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003534720 00000100:00100000:3.0:1787365270.083608:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 211 00000100:00100000:3.0:1787365270.083617:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+59:11619:x1874188003534720:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1787365270.084486:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365270.084523:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47b04 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989345 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.086448:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47b0b lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 6 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.086471:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47b0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.086484:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47b0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.086501:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47b12 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.086523:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47b12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.086531:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47b12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.086829:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb47b19 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.086838:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb47b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.086846:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb47b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365270.086878:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787365270.086974:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365270.087057:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb47b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.087069:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb47b19 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.087077:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47b0b lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.087083:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47b0b lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.087090:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47b0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.087107:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365270.087111:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47b0b lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.087118:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47b0b lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.087129:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:2.0:1787365270.087132:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365270.087136:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47b0b lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.087142:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47b0b lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 6 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.087154:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47b12 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.087160:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47b12 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.087166:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47b12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.087171:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365270.087174:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47b12 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.087179:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47b12 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.087193:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f27988df900) 00010000:00010000:2.0:1787365270.087250:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365270.087254:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47b12 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.087260:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47b12 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.087295:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47b04 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989345 expref: 61 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.087307:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb47b19 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989345 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.087314:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:2.0:1787365270.087317:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787365270.087319:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb709e00, rc 0) 00000100:00100000:2.0:1787365270.087499:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb408a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+60:11619:x1874188003534720:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 3882us (4047us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365270.087508:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 211 00000100:00100000:3.0:1787365270.093105:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365270.096851:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003534848 00000100:00100000:0.0:1787365270.096864:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003534848 00000100:00100000:0.0:1787365270.096944:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1787365270.096955:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+60:2361:x1874188003534848:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787365270.096972:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365270.097008:0:5818:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb47b19 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989345 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.097036:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:0.0:1787365270.097042:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365270.097104:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63b0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+59:2361:x1874188003534848:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 151us (4008us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365270.097130:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:1.0:1787365270.098291:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365270.099068:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003535104 00000100:00100000:0.0:1787365270.099077:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003535104 00000100:00100000:0.0:1787365270.099175:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 212 00000100:00100000:0.0:1787365270.099185:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+59:11619:x1874188003535104:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1787365270.099212:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365270.099232:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23000/0x872d29295eb47b20 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898934c expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.099324:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22200/0x872d29295eb47b27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.099339:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47aef lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989337 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.099347:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22200/0x872d29295eb47b27 lrc: 4/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.099380:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47aef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989337 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.099393:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47aef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989337 expref: 60 pid: 5835 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365270.099407:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb730a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1874188024494208:192.168.203.13@tcp:104: 00000100:00100000:0.0:1787365270.099496:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b64c6b40 going to sleep for 11 seconds 00000100:00100000:0.0:1787365270.103905:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb730a80 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1874188024494208:192.168.203.13@tcp:104: 00010000:00010000:0.0:1787365270.103948:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22200/0x872d29295eb47b27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365270.106120:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365270.106366:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003535232 00000100:00100000:0.0:1787365270.106374:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003535232 00010000:00010000:0.0:1787365270.106414:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47aef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989337 expref: 61 pid: 5835 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365270.106452:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:0.0:1787365270.106463:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb408000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+61:2362:x1874188003535232:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787365270.106478:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365270.106484:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47aef lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989337 expref: 61 pid: 5835 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.106496:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47aef lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989337 expref: 61 pid: 5835 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.106518:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44800/0x872d29295eb47aef lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989337 expref: 61 pid: 5835 timeout: 487 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.106533:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:0.0:1787365270.106539:0:8435:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22200/0x872d29295eb47b27 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.106547:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22200/0x872d29295eb47b27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.106554:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22200/0x872d29295eb47b27 lrc: 4/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.106595:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365270.106810:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb408000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+60:2362:x1874188003535232:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 348us (698us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365270.106818:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 77 00010000:00010000:1.0:1787365270.109962:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22200/0x872d29295eb47b27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365270.109980:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22200/0x872d29295eb47b27 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787365270.110015:0:6704:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:1.0:1787365270.110189:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23000/0x872d29295eb47b20 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898934c expref: 61 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365270.110462:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22200/0x872d29295eb47b27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898934c expref: 60 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365270.110472:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:1.0:1787365270.110475:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787365270.110478:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27b6e22200, rc 0) 00000100:00100000:1.0:1787365270.110544:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+60:11619:x1874188003535104:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 11360us (12258us total) trans 4294967502 rc 0/0 00000100:00100000:1.0:1787365270.110553:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 212 00000100:00100000:1.0:1787365270.116417:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365270.116500:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003535488 00000100:00100000:2.0:1787365270.116509:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003535488 00000100:00100000:2.0:1787365270.116567:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:2.0:1787365270.116576:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb409f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+60:11619:x1874188003535488:12345-192.168.203.13@tcp:103:lfs.0 00010000:00010000:2.0:1787365270.116592:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365270.116614:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114a00/0x872d29295eb47a86 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989322 expref: 60 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.116868:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:2.0:1787365270.116873:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365270.116919:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb409f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+59:11619:x1874188003535488:12345-192.168.203.13@tcp:103:lfs.0 Request processed in 343us (510us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365270.116927:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:3.0:1787365270.120166:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365270.120375:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003535616 00000100:00100000:0.0:1787365270.120384:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003535616 00000100:00100000:0.0:1787365270.120433:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 213 00000100:00100000:0.0:1787365270.120441:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+59:11619:x1874188003535616:12345-192.168.203.13@tcp:58:lfs.0 00010000:00010000:0.0:1787365270.120537:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23600/0x872d29295eb47b35 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.120552:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23600/0x872d29295eb47b35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.120564:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23600/0x872d29295eb47b35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787365270.120976:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].5, 136 off8872 00000100:00100000:1.0:1787365270.129307:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63b3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+59:11619:x1874188003535616:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 8855us (9138us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365270.129340:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 213 00000100:00100000:3.0:1787365270.143418:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365270.143922:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003535744 00000100:00100000:2.0:1787365270.143934:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003535744 00000100:00100000:2.0:1787365270.144005:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 214 00000100:00100000:2.0:1787365270.144015:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+59:11619:x1874188003535744:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1787365270.144043:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365270.144064:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47b3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989353 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.144117:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23600/0x872d29295eb47b35 lrc: 2/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.144128:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47b3c lrc: 4/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989353 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.144145:0:5833:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23600/0x872d29295eb47b35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.144157:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47b3c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989353 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.144168:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:2.0:1787365270.144183:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787365270.144188:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47b3c lrc: 3/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989353 expref: 60 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.144207:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb709400, rc 0) 00000100:00100000:2.0:1787365270.144268:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63b3480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+60:11619:x1874188003535744:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 254us (858us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365270.144276:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 214 00000004:00080000:3.0:1787365270.387640:0:8089:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 387551995730ns, next at 388551992277ns, rc = 0 00000100:00100000:3.0:1787365270.387674:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024494720:0@lo:400:kworker.0 00000100:00100000:2.0:1787365270.387725:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024494336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787365270.387786:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365270.387833:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024494848:0@lo:400:kworker.0 00000100:00100000:2.0:1787365270.387857:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365270.387892:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024494336 00000100:00100000:2.0:1787365270.387898:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024494336 00000100:00100000:2.0:1787365270.387951:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787365270.387960:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874188024494336:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787365270.387992:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365270.388047:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b64000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3313:x1874188024494336:12345-0@lo:13:osp-pre-1-0.0 Request processed in 88us (261us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365270.388054:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 76 00000100:00100000:2.0:1787365270.388098:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024494336:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787365270.388138:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024494848 00000100:00100000:2.0:1787365270.388143:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024494848 00000100:00100000:2.0:1787365270.388169:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787365270.388176:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024494848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365270.388210:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b65f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024494848:12345-0@lo:400:kworker.0 Request processed in 35us (352us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365270.388230:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 87 00000100:00100000:2.0:1787365270.388250:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024494592:0@lo:400:kworker.0 00000100:00100000:2.0:1787365270.388280:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365270.388298:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024495104:0@lo:400:kworker.0 00000100:00100000:2.0:1787365270.388318:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365270.388335:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [0->1] 00000100:00100000:2.0:1787365270.388342:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024494464:0@lo:400:kworker.0 00000100:00100000:2.0:1787365270.388367:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365270.388390:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874188024494976:0@lo:400:kworker.0 00000100:00100000:2.0:1787365270.388412:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365270.388437:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024495104 00000100:00100000:2.0:1787365270.388442:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024495104 00000100:00100000:2.0:1787365270.388464:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787365270.388471:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1874188024495104:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365270.388507:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1874188024495104:12345-0@lo:400:kworker.0 Request processed in 36us (188us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365270.388514:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 88 00000100:00100000:2.0:1787365270.388536:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024495104:0@lo:400:kworker.0 00000100:00100000:2.0:1787365270.388557:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967309 gen 2 00000004:00080000:2.0:1787365270.388562:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f2798024a80, transno 4294967307 00000004:00080000:2.0:1787365270.388572:0:3313:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967309 committed transno 4294967309 00000100:00100000:2.0:1787365270.388586:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024494848:0@lo:400:kworker.0 00000100:00100000:2.0:1787365270.388602:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024494592 00000100:00100000:2.0:1787365270.388606:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024494592 00000100:00100000:2.0:1787365270.388652:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024494976 00000100:00100000:2.0:1787365270.388661:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024494976 00000100:00100000:2.0:1787365270.388699:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787365270.388706:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024494592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365270.388744:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b66a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024494592:12345-0@lo:400:kworker.0 Request processed in 39us (463us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365270.388752:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 170 00000100:00100000:2.0:1787365270.388764:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787365270.388770:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874188024494976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365270.388796:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b67800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874188024494976:12345-0@lo:400:kworker.0 Request processed in 28us (384us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365270.388802:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 171 00000100:00100000:2.0:1787365270.388825:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc7800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874188024494976:0@lo:400:kworker.0 00000100:00100000:2.0:1787365270.388834:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb733b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024494592:0@lo:400:kworker.0 00000100:00100000:2.0:1787365270.388868:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024494464 00000100:00100000:2.0:1787365270.388871:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024494464 00000100:00080000:1.0:1787365270.388875:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:1.0:1787365270.388879:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787365270.388899:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787365270.388907:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3311:x1874188024494464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365270.388946:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795d850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3311:x1874188024494464:12345-0@lo:400:kworker.0 Request processed in 40us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365270.388952:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 301 00000100:00100000:2.0:1787365270.388986:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb730a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024494464:0@lo:400:kworker.0 00000100:00100000:3.0:1787365270.389149:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365270.389465:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024494720 00000100:00100000:2.0:1787365270.389470:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024494720 00000100:00080000:1.0:1787365270.389508:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365270.389557:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 172 00000100:00100000:2.0:1787365270.389566:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024494720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365270.389622:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63b3b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024494720:12345-0@lo:400:kworker.0 Request processed in 57us (472us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365270.389649:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 172 00000100:00100000:0.0:1787365270.389702:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024494720:0@lo:400:kworker.0 00000040:00080000:0.0:1787365270.706874:0:11664:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:0.0:1787365270.706883:0:11664:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:0.0:1787365270.706921:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:0.0:1787365270.706928:0:11664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787365270.707072:0:11664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbdc6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11664:1874188024495232:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787365270.707179:0:11664:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b64c6240 going to sleep for 11 seconds 00000100:00100000:0.0:1787365270.712308:0:11664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbdc6a00 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11664:1874188024495232:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787365270.714191:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365270.714731:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003535872 00000100:00100000:2.0:1787365270.714749:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003535872 00000100:00100000:2.0:1787365270.714874:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 215 00000100:00100000:2.0:1787365270.714886:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+60:11620:x1874188003535872:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:2.0:1787365270.714915:0:6704:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:2.0:1787365270.715025:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63b1f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+60:11620:x1874188003535872:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 132us (832us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365270.715033:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 215 00000100:00100000:2.0:1787365270.736511:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365270.736590:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003536000 00000100:00100000:3.0:1787365270.736598:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003536000 00000100:00100000:3.0:1787365270.736683:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 216 00000100:00100000:3.0:1787365270.736693:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+60:11620:x1874188003536000:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:3.0:1787365270.736771:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47b43 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.736806:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47b43 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.736818:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47b43 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.736834:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47b4a lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.736841:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47b4a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.736848:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47b4a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.736871:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47b51 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.736879:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47b51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.736886:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47b51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365270.736923:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:3.0:1787365270.736927:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787365270.736938:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47b51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.736948:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47b43 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.736962:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47b43 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.736969:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47b43 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.736974:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365270.736978:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47b43 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.736985:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47b43 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.736997:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f27988dfd00) 00010000:00010000:3.0:1787365270.737000:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365270.737004:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47b43 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.737011:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47b43 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.737034:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47b4a lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.737040:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47b4a lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.737045:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47b4a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.737050:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365270.737059:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47b4a lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.737066:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47b4a lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.737074:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0xafd4eada (ffff9f2789e48c00) 00010000:00010000:3.0:1787365270.737077:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365270.737080:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47b4a lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.737085:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47b4a lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0xafd4eada bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.737098:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47b51 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.737104:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47b51 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.737110:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47b51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.737115:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365270.737118:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47b51 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.737124:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47b51 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.737130:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:3.0:1787365270.737132:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365270.737142:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47b51 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.737147:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47b51 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365270.737215:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b67480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+60:11620:x1874188003536000:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 523us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365270.737223:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 216 00000100:00100000:1.0:1787365270.742861:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365270.742951:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003536256 00000100:00100000:2.0:1787365270.742962:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003536256 00000100:00100000:2.0:1787365270.743029:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 217 00000100:00100000:2.0:1787365270.743040:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb40aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+60:11620:x1874188003536256:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365270.743061:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365270.743081:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47b58 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898935a expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.743177:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47b5f lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.743193:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.743205:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365270.743228:0:5834:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787365270.743321:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47b5f lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.743330:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47b5f lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.743337:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47b5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.743342:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365270.743346:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47b5f lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.743365:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47b5f lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.743379:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:2.0:1787365270.743382:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:2.0:1787365270.743386:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47b5f lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.743391:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47b5f lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.743430:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47b58 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898935a expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.743440:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f27988dfd00) 00010000:00010000:2.0:1787365270.743443:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787365270.743454:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47b58 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898935a expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.743463:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb708600, rc 0) 00000100:00100000:2.0:1787365270.743526:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb40aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+61:11620:x1874188003536256:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 488us (673us total) trans 4294967503 rc 301/301 00000100:00100000:2.0:1787365270.743534:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 217 00000100:00100000:0.0:1787365270.757215:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365270.757453:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003536384 00000100:00100000:3.0:1787365270.757463:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003536384 00000100:00100000:3.0:1787365270.757519:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 218 00000100:00100000:3.0:1787365270.757529:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+61:11620:x1874188003536384:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787365270.757561:0:5833:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787365270.757705:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+61:11620:x1874188003536384:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 176us (497us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365270.757713:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 218 00000100:00100000:0.0:1787365270.768316:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365270.768408:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003536640 00000100:00100000:2.0:1787365270.768418:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003536640 00000100:00100000:2.0:1787365270.768482:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 219 00000100:00100000:2.0:1787365270.768492:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+61:11620:x1874188003536640:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365270.768512:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365270.768515:0:5834:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 2 locks, starting at 1 00010000:00010000:2.0:1787365270.768541:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23200/0x872d29295eb47afd lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898933e expref: 61 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.768570:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:2.0:1787365270.768576:0:5834:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787365270.768589:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47b6d lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989361 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:2.0:1787365270.769065:0:5834:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x6:0x0], index 1: 0 00010000:00010000:2.0:1787365270.769247:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47b74 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.769260:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47b74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.769271:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47b74 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.769332:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47b6d lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989361 expref: 63 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.769347:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47b74 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989361 expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.769355:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f27988df900) 00010000:00010000:2.0:1787365270.769358:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787365270.769361:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb709a00, rc 0) 00000100:00100000:2.0:1787365270.769414:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+62:11620:x1874188003536640:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 922us (1106us total) trans 4294967504 rc 0/0 00000100:00100000:2.0:1787365270.769421:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 219 00000100:00100000:1.0:1787365270.777607:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365270.779166:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003536896 00000100:00100000:3.0:1787365270.779179:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003536896 00000100:00100000:3.0:1787365270.779340:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 220 00000100:00100000:3.0:1787365270.779350:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb40a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+62:11620:x1874188003536896:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787365270.779405:0:5833:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365270.779431:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709a00/0x872d29295eb47b74 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989361 expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.779450:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f27988df900) 00010000:00010000:3.0:1787365270.779460:0:5833:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787365270.779482:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47b82 lrc: 3/0,1 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.779509:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47b82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.779519:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47b82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.779534:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47b89 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xa:0x0].0x8cf48898 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.779540:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47b89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8cf48898 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.779547:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47b89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8cf48898 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.779617:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47b82 lrc: 3/0,1 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.779667:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47b82 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.779675:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47b82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.779688:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365270.779692:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47b82 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.779708:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47b82 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.779717:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:3.0:1787365270.779726:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365270.779730:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47b82 lrc: 2/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.779745:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47b82 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.779762:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47b89 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xa:0x0].0x8cf48898 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.779768:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47b89 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8cf48898 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.779773:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47b89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8cf48898 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.779777:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365270.779780:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47b89 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8cf48898 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.779786:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47b89 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xa:0x0].0x8cf48898 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.779794:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x8cf48898 (ffff9f2789e48c00) 00010000:00010000:3.0:1787365270.779805:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365270.779809:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47b89 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8cf48898 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365270.779813:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47b89 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xa:0x0].0x8cf48898 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365270.779896:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb40a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+61:11620:x1874188003536896:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 548us (2297us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787365270.779910:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 220 00000100:00100000:0.0:1787365270.797557:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365270.798007:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003537024 00000100:00100000:2.0:1787365270.798070:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003537024 00000100:00100000:2.0:1787365270.798170:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 221 00000100:00100000:2.0:1787365270.798181:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+61:11620:x1874188003537024:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365270.798209:0:5834:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365270.798231:0:5834:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47b90 lrc: 2/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989368 expref: -99 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.798265:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb47b97 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.798279:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb47b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.798300:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb47b97 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.798399:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47b90 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989368 expref: 63 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.798415:0:5834:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb47b97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989368 expref: 62 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.798424:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f27988dfa00) 00010000:00010000:2.0:1787365270.798427:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787365270.798430:0:5834:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb709e00, rc 0) 00000100:00100000:2.0:1787365270.798492:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+62:11620:x1874188003537024:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 312us (945us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365270.798499:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 221 00000100:00100000:1.0:1787365270.804799:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365270.804866:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003537280 00000100:00100000:2.0:1787365270.804876:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003537280 00000100:00100000:2.0:1787365270.804928:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 222 00000100:00100000:2.0:1787365270.804938:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb40b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+62:11620:x1874188003537280:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787365270.805028:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47b9e lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.805044:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47b9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.805055:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47b9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787365270.805289:0:5835:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x6:0x0].8, 88 off8800 00000004:00010000:2.0:1787365270.805690:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000abcffbef reply state 00000000055769fc transno 4294967505 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47b9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365270.805713:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787365270.805800:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb40b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+64:11620:x1874188003537280:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 861us (1009us total) trans 4294967505 rc 0/0 00000100:00100000:2.0:1787365270.805808:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 222 00010000:00010000:0.0:1787365270.810298:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47b9e lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.810315:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47b9e lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.810323:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47b9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.810337:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365270.810343:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47b9e lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.810351:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47b9e lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.810366:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f27988dfa00) 00010000:00010000:0.0:1787365270.810369:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:0.0:1787365270.810374:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47b9e lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.810380:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708c00/0x872d29295eb47b9e lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365270.810868:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365270.812701:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003537408 00000100:00100000:2.0:1787365270.812714:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003537408 00000100:00100000:2.0:1787365270.812788:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 223 00000100:00100000:2.0:1787365270.812798:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb40a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+63:11620:x1874188003537408:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365270.812826:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365270.812850:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47ba5 lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898936f expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.812902:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47ba5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898936f expref: 64 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.812917:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47ba5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898936f expref: 64 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.812937:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f27988dfa00) 00010000:00010000:2.0:1787365270.812940:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787365270.812944:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb708600, rc 0) 00000100:00100000:2.0:1787365270.813000:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb40a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+64:11620:x1874188003537408:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 203us (2136us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365270.813007:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 223 00000100:00100000:3.0:1787365270.821957:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365270.822970:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003537536 00000100:00100000:2.0:1787365270.822983:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003537536 00000100:00100000:2.0:1787365270.823091:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:2.0:1787365270.823102:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:2362:x1874188003537536:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00100000:2.0:1787365270.823377:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63b0700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+10:2362:x1874188003537536:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 276us (1428us total) trans 4294967319 rc 0/0 00000100:00100000:2.0:1787365270.823386:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00080000:1.0:1787365270.823544:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787365270.829338:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365270.829450:0:11946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003537792 00000100:00100000:3.0:1787365270.829459:0:11946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003537792 00000100:00100000:1.0:1787365270.829975:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:1.0:1787365270.829989:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+64:11620:x1874188003537792:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787365270.830235:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+65:11620:x1874188003537792:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 249us (905us total) trans 4294967506 rc 0/0 00000100:00100000:1.0:1787365270.830242:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 60 00000100:00100000:1.0:1787365270.834962:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365270.835055:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003538048 00000100:00100000:2.0:1787365270.835066:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003538048 00000100:00100000:2.0:1787365270.835125:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 224 00000100:00100000:2.0:1787365270.835136:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb40bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+65:11620:x1874188003538048:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787365270.835298:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb40bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+65:11620:x1874188003538048:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 163us (360us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365270.835306:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 224 00000100:00100000:3.0:1787365270.838456:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365270.839007:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003538176 00000100:00100000:2.0:1787365270.839024:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003538176 00000100:00100000:2.0:1787365270.839134:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 225 00000100:00100000:2.0:1787365270.839147:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb55b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+65:11620:x1874188003538176:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365270.839166:0:6704:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365270.839187:0:6704:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb47bac lrc: 2/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989376 expref: -99 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.839282:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb47bb3 lrc: 3/1,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.839297:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb47bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.839311:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb47bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365270.839357:0:6704:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365270.839382:0:6704:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb47bb3 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.839410:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb47bac lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989376 expref: 67 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.839428:0:6704:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb47bb3 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989376 expref: 66 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.839437:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f27988dfa00) 00010000:00010000:2.0:1787365270.839440:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:2.0:1787365270.839444:0:6704:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb708800, rc 0) 00000100:00100000:2.0:1787365270.839502:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb55b800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+66:11620:x1874188003538176:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 360us (1052us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365270.839510:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 225 00000100:00100000:0.0:1787365270.842218:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365270.843347:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003538304 00000100:00100000:1.0:1787365270.843358:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003538304 00000100:00100000:1.0:1787365270.843465:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:1.0:1787365270.843477:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbdc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+10:2362:x1874188003538304:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787365270.843495:0:6680:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365270.843514:0:6680:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002321b5d0/0x872d29295eb47bba lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898937d expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787365270.843540:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a890796, blocks: 0x1 00010000:00010000:1.0:1787365270.843559:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=388s v=(0 0) 00010000:00010000:1.0:1787365270.843565:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365270.843587:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002321b5d0/0x872d29295eb47bba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898937d expref: 11 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365270.843607:0:6680:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000002321b5d0/0x872d29295eb47bba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898937d expref: 11 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365270.843620:0:6680:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115800, rc 0) 00000100:00100000:1.0:1787365270.843716:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbdc7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+11:2362:x1874188003538304:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 242us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365270.843724:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:1.0:1787365270.849411:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365270.849857:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003538560 00000100:00100000:3.0:1787365270.849867:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003538560 00000100:00100000:2.0:1787365270.850464:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 226 00000100:00100000:2.0:1787365270.850476:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+66:11620:x1874188003538560:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:2.0:1787365270.850661:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+66:11620:x1874188003538560:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 186us (1259us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365270.850669:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 226 00000100:00100000:3.0:1787365270.854415:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365270.854501:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003538688 00000100:00100000:1.0:1787365270.854510:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003538688 00000100:00100000:1.0:1787365270.854563:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:1.0:1787365270.854572:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+11:11620:x1874188003538688:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787365270.854589:0:6681:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365270.854606:0:6681:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb47bc1 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989384 expref: -99 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365270.854672:0:6681:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000002321b5d0/0x872d29295eb47bba lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898937d expref: 12 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365270.854682:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365270.854686:0:6681:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365270.854692:0:6681:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb47bc1 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989384 expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365270.854747:0:6681:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000002321b5d0/0x872d29295eb47bba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898937d expref: 12 pid: 6680 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365270.854763:0:6681:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000002321b5d0/0x872d29295eb47bba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898937d expref: 12 pid: 6680 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365270.854777:0:6681:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb40ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1874188024495360:192.168.203.13@tcp:104: 00000100:00100000:1.0:1787365270.854853:0:6681:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27c00fe540 going to sleep for 11 seconds 00000100:00100000:2.0:1787365270.859390:0:6681:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb40ad80 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:6681:1874188024495360:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365270.859429:0:6681:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb47bc1 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->4095] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989384 expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.859471:0:6681:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798114000, rc 0) 00000100:00100000:2.0:1787365270.859535:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+12:11620:x1874188003538688:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 4963us (5128us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365270.859544:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:2.0:1787365270.861108:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365270.861651:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003538816 00000100:00100000:0.0:1787365270.861660:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003538816 00010000:00010000:0.0:1787365270.861700:0:8434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000002321b5d0/0x872d29295eb47bba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898937d expref: 12 pid: 6680 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365270.861768:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:0.0:1787365270.861778:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+12:2361:x1874188003538816:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787365270.861793:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365270.861816:0:8434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000002321b5d0/0x872d29295eb47bba lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898937d expref: 12 pid: 6680 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.861830:0:8434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000002321b5d0/0x872d29295eb47bba lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898937d expref: 12 pid: 6680 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.861852:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002321b5d0/0x872d29295eb47bba lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898937d expref: 12 pid: 6680 timeout: 488 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.861868:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365270.861872:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365270.861879:0:8434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb47bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989384 expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.861900:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb47bc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989384 expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.861938:0:8434:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb47bc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989384 expref: 11 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365270.861952:0:8434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbb8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8434:1874188024495488:192.168.203.13@tcp:105: 00000100:00100000:0.0:1787365270.862041:0:8434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b64c6240 going to sleep for 11 seconds 00000100:00100000:0.0:1787365270.877068:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365270.877164:0:6688:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003538944 00000100:00100000:1.0:1787365270.877173:0:6688:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003538944 00002000:00100000:1.0:1787365270.877221:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9f27bbbb8a80 x1874188003538944/t0(0) o4->8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp:176/0 lens 504/0 e 0 to 0 dl 1787365281 ref 1 fl New:/600/ffffffff rc 0/-1 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787365270.877233:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f27bbbb8a80 with x1874188003538944 ext(0->12) 00002000:00010000:1.0:1787365270.877239:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f27bbbb8a80 00000100:00100000:1.0:1787365270.877272:0:6688:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1787365270.877282:0:6688:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+12:2361:x1874188003538944:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 00000100:00100000:1.0:1787365270.877868:0:6688:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbb8a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+14:2361:x1874188003538944:12345-192.168.203.13@tcp:4:lhsmtool_posix.0 Request processed in 586us (807us total) trans 4294967320 rc 0/0 00000100:00100000:1.0:1787365270.877876:0:6688:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00002000:00100000:1.0:1787365270.877884:0:6688:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_002: refresh rw locks for [0x280000400:0x6:0x0] (0->12) req@ffff9f27bbbb8a80 x1874188003538944/t4294967320(0) o4->8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp:176/0 lens 504/448 e 0 to 0 dl 1787365281 ref 1 fl Complete:/600/0 rc 0/0 job:'lhsmtool_posix.0' uid:0 gid:0 projid:0 00002000:00100000:1.0:1787365270.877892:0:6688:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f27bbbb8a80 with x1874188003538944 ext(0->12) 00002000:00010000:1.0:1787365270.877904:0:6688:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f27bbbb8a80 00000100:00100000:2.0:1787365270.878912:0:8434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbb8e00 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_003:lustre-OST0001_UUID:8434:1874188024495488:192.168.203.13@tcp:105: 00010000:00010000:2.0:1787365270.878938:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365270.878985:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b66300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:2361:x1874188003538816:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 17208us (17883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365270.878995:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:0.0:1787365270.889524:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365270.889680:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003539072 00000100:00100000:1.0:1787365270.889690:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003539072 00000100:00100000:1.0:1787365270.889755:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 227 00000100:00100000:1.0:1787365270.889766:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+66:11620:x1874188003539072:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00010000:00010000:0.0:1787365270.899522:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787365270.949273:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967497 is committed 00000004:00080000:1.0:1787365270.949286:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 9 committed 00000001:00080000:1.0:1787365270.949316:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967506 is committed 00000004:00080000:1.0:1787365270.949351:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 6 committed 00000020:00080000:1.0:1787365270.949368:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f268473f000 refcount 2 committed 0 result 0 batchid 7 00000020:00080000:1.0:1787365270.949372:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f27bb70c200 obd lustre-OST0000-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f268473f780 00000020:00080000:1.0:1787365270.949375:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f27bb70ce00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f27bf0c1c00 00000020:00080000:1.0:1787365270.950211:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f268473f840 refcount 2 committed 0 result 0 batchid 6 00000020:00080000:1.0:1787365270.950218:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f27bb70c700 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f27867ad9c0 00000020:00080000:1.0:1787365270.950221:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f27bb70c900 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f27bf0b9c00 00000004:00080000:1.0:1787365270.950234:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 10 committed 00000020:00080000:1.0:1787365270.950362:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 7 committed batchid 5 00000100:00100000:3.0:1787365270.950752:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787365270.950774:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024495616:0@lo:6:osp-syn-0-0.0 00000100:00100000:3.0:1787365270.950842:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365270.951130:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787365270.951140:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024495744:0@lo:6:osp-syn-1-0.0 00000100:00100000:0.0:1787365270.951174:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000020:00080000:1.0:1787365270.951801:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 5 00000100:00100000:1.0:1787365270.951895:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbb9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+20:11620:x1874188003539072:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 62128us (62376us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365270.951905:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 227 00000100:00100000:1.0:1787365270.954350:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024495616 00000100:00100000:1.0:1787365270.954364:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024495616 00000100:00100000:1.0:1787365270.954436:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024495744 00000100:00100000:1.0:1787365270.954440:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024495744 00000100:00100000:1.0:1787365270.954468:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787365270.954488:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024495616:12345-0@lo:6:osp-syn-0-0.0 00002000:00080000:1.0:1787365270.954529:0:6680:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0000: Destroy object 0x240000400:5 count 1 00002000:00010000:1.0:1787365270.954562:0:6680:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x5:0x0] initial LVB size: 9, mtime: 0x6a890794, atime: 0x6a890794, ctime: 0x6a890794, blocks: 0xb 00010000:00010000:1.0:1787365270.954570:0:6680:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4ea2acc/0x872d29295eb47bc8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365270.954585:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=388s v=(0 0) 00010000:00010000:1.0:1787365270.954589:0:6680:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x5:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365270.954596:0:6680:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000d4ea2acc/0x872d29295eb47bc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365270.954611:0:6680:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000d4ea2acc/0x872d29295eb47bc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365270.954622:0:6680:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000d4ea2acc/0x872d29295eb47bc8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365270.954979:0:6680:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000d4ea2acc/0x872d29295eb47bc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365270.954998:0:6680:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787365270.955960:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:0.0:1787365270.955977:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3312:x1874188024495744:12345-0@lo:6:osp-syn-1-0.0 00002000:00080000:0.0:1787365270.955999:0:6682:0:(ofd_dev.c:1862:ofd_destroy_hdl()) lustre-OST0001: Destroy object 0x280000400:5 count 1 00010000:00010000:0.0:1787365270.956029:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47bcf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.956048:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb4798a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000080000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892e3 expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.956056:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x5:0x0].0x0 since=3s v=(0 0) 00010000:00010000:0.0:1787365270.956059:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787365270.956064:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47bcf lrc: 4/0,1 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.956097:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb4798a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000080010020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892e3 expref: 12 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.956111:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb4798a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000480010020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892e3 expref: 12 pid: 6681 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365270.956138:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbbb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1874188024495872:192.168.203.13@tcp:104: 00000100:00100000:0.0:1787365270.956208:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b64c6240 going to sleep for 11 seconds 00000100:00100000:1.0:1787365270.956369:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3313:x1874188024495616:12345-0@lo:6:osp-syn-0-0.0 Request processed in 1881us (5525us total) trans 4294967310 rc 0/0 00000100:00100000:1.0:1787365270.956377:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00010000:00010000:1.0:1787365270.956544:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365270.956551:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000d4ea2acc/0x872d29295eb47bc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365270.956571:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114400 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365270.956576:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4ea2acc/0x872d29295eb47bc8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365270.956586:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000d4ea2acc/0x872d29295eb47bc8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365270.956604:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000d4ea2acc/0x872d29295eb47bc8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365270.956611:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000d4ea2acc/0x872d29295eb47bc8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6680 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:0.0:1787365270.957394:0:3313:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f27bb409c00/2, rc 0, transno 4294967310 00000100:00100000:0.0:1787365270.957405:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb409c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024495616:0@lo:6:osp-syn-0-0.0 00010000:00010000:1.0:1787365270.957500:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365270.957503:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365270.957562:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365270.962793:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365270.962873:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365270.963154:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003539200 00000100:00100000:1.0:1787365270.963164:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003539200 00010000:00010000:1.0:1787365270.963205:0:5819:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb4798a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892e3 expref: 13 pid: 6681 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365270.963240:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:1.0:1787365270.963251:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27882b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:2362:x1874188003539200:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365270.963265:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365270.963271:0:5819:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb4798a lrc: 5/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000480010020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892e3 expref: 13 pid: 6681 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365270.963299:0:5819:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb4798a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000480010020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892e3 expref: 13 pid: 6681 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365270.963327:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787365270.963331:0:5819:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x5:0x0].0x0 since=0s v=(1 0) 00010000:00010000:1.0:1787365270.963337:0:5819:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47bcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365270.963347:0:5819:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47bcf lrc: 4/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50090080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365270.963368:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365270.963433:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27882b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:2362:x1874188003539200:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 184us (649us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365270.963440:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:1.0:1787365270.963575:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003539328 00000100:00100000:1.0:1787365270.963580:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003539328 00000100:00100000:1.0:1787365270.963606:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:1.0:1787365270.963612:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+13:2362:x1874188003539328:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00010000:00010000:0.0:1787365270.967502:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb4798a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801480010020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892e3 expref: 13 pid: 6681 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365270.967526:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbbb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1874188024495872:192.168.203.13@tcp:104: 00010000:00010000:0.0:1787365270.967551:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47bcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.967564:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47bcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.967572:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47bcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.967582:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47bcf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.967590:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47bcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365270.967619:0:6682:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:0.0:1787365270.968180:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbbbb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1874188024495744:12345-0@lo:6:osp-syn-1-0.0 Request processed in 12207us (17003us total) trans 4294967321 rc 0/0 00000100:00100000:0.0:1787365270.968189:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000004:00080000:0.0:1787365270.968235:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f27b6b67b80/2, rc 0, transno 4294967321 00000100:00100000:0.0:1787365270.968248:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6b67b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024495744:0@lo:6:osp-syn-1-0.0 00010000:00010000:2.0:1787365270.968324:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787365270.968331:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47bcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.968341:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e23e00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:2.0:1787365270.968345:0:5821:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47bcf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.968354:0:5821:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47bcf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.968372:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47bcf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.968392:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47bcf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x5:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365270.968412:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365270.968414:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365270.968415:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787365271.003485:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967320 is committed 00000001:00080000:1.0:1787365271.003506:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967317 is committed 00000100:00100000:2.0:1787365271.003673:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2362:x1874188003539328:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 40056us (40794us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365271.003684:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:3.0:1787365271.011971:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365271.012571:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003539584 00000100:00100000:0.0:1787365271.012582:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003539584 00000100:00100000:0.0:1787365271.012685:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 228 00000100:00100000:0.0:1787365271.012695:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+20:11620:x1874188003539584:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:0.0:1787365271.012747:0:5835:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365271.012772:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708800/0x872d29295eb47bb3 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989376 expref: 20 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.012791:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f27988dfa00) 00010000:00010000:0.0:1787365271.012796:0:5835:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:0.0:1787365271.012826:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23000/0x872d29295eb47bd6 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.012841:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23000/0x872d29295eb47bd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.012850:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23000/0x872d29295eb47bd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787365271.013669:0:5835:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000004378f27e reply state 00000000aa93aa03 transno 4294967507 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23000/0x872d29295eb47bd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365271.013685:0:5835:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787365271.013853:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b37480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:11620:x1874188003539584:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 1158us (1888us total) trans 4294967507 rc 0/0 00000100:00100000:3.0:1787365271.013862:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 228 00010000:00010000:3.0:1787365271.017118:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23000/0x872d29295eb47bd6 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.017136:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23000/0x872d29295eb47bd6 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.017144:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23000/0x872d29295eb47bd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.017168:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e23000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365271.017173:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23000/0x872d29295eb47bd6 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.017180:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23000/0x872d29295eb47bd6 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.017196:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f27988dfa00) 00010000:00010000:3.0:1787365271.017199:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365271.017204:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23000/0x872d29295eb47bd6 lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.018176:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23000/0x872d29295eb47bd6 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365271.020008:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365271.020148:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003539712 00000100:00100000:2.0:1787365271.020159:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003539712 00000100:00100000:2.0:1787365271.020218:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:2.0:1787365271.020227:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2360:x1874188003539712:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:2.0:1787365271.021543:0:6681:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 0 -> 13 00002000:00010000:2.0:1787365271.021551:0:6681:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 0 -> 1787365269 00002000:00010000:2.0:1787365271.021554:0:6681:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 0 -> 1787365268 00002000:00010000:2.0:1787365271.021557:0:6681:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787365270 -> 1787365269 00002000:00010000:2.0:1787365271.021559:0:6681:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 1 -> 11 00000100:00100000:2.0:1787365271.021649:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb408000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2360:x1874188003539712:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 1419us (1644us total) trans 4294967322 rc 0/0 00000100:00100000:2.0:1787365271.021660:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:1.0:1787365271.030929:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365271.031025:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003539968 00000100:00100000:2.0:1787365271.031034:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003539968 00000100:00100000:2.0:1787365271.031095:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 229 00000100:00100000:2.0:1787365271.031104:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+20:11620:x1874188003539968:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 00010000:00010000:2.0:1787365271.031186:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb47bdd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.031201:0:6704:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb47b97 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989368 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.031210:0:6704:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb47bdd lrc: 4/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.031244:0:6704:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb47b97 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989368 expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.031257:0:6704:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb47b97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989368 expref: 20 pid: 5834 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365271.031271:0:6704:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6b65500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1874188024496000:192.168.203.13@tcp:104: 00000100:00100000:2.0:1787365271.031369:0:6704:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2797b01480 going to sleep for 11 seconds 00000100:00100000:2.0:1787365271.054003:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365271.054674:0:5818:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003540096 00000100:00100000:0.0:1787365271.054698:0:5818:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003540096 00010000:00010000:0.0:1787365271.054767:0:5818:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb47b97 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989368 expref: 21 pid: 5834 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365271.054820:0:5818:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:0.0:1787365271.054830:0:5818:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:2362:x1874188003540096:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787365271.054854:0:5818:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365271.054862:0:5818:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb47b97 lrc: 5/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989368 expref: 21 pid: 5834 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.054876:0:5818:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb47b97 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989368 expref: 21 pid: 5834 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.054912:0:5818:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f27988dfa00) 00010000:00010000:0.0:1787365271.054917:0:5818:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb47bdd lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.054927:0:5818:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb47bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.054934:0:5818:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb47bdd lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.054953:0:5818:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365271.055021:0:5818:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:2362:x1874188003540096:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 184us (1018us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365271.055030:0:5818:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 80 00010000:00010000:1.0:1787365271.058854:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709e00/0x872d29295eb47b97 lrc: 0/0,0 mode: --/PR res: [0x200000401:0x10:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989368 expref: 20 pid: 5834 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365271.058898:0:6704:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6b65500 pname:cluuid:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000_UUID:6704:1874188024496000:192.168.203.13@tcp:104: 00010000:00010000:1.0:1787365271.059562:0:6704:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb47bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.059797:0:6704:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb47bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.059818:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb47bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.059850:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb47bdd lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.059857:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb47bdd lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.059863:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb47bdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.059869:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365271.059872:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb47bdd lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.059879:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb47bdd lrc: 4/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.059912:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f27988dfa00) 00010000:00010000:0.0:1787365271.059915:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 21 00010000:00010000:0.0:1787365271.059919:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb47bdd lrc: 2/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.059926:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708400/0x872d29295eb47bdd lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x21/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365271.060009:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb409f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+19:11620:x1874188003539968:12345-192.168.203.13@tcp:55:lhsmtool_posix.0 Request processed in 28904us (29086us total) trans 0 rc -22/-22 00000100:00100000:0.0:1787365271.060028:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 229 00000100:00100000:2.0:1787365271.064846:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365271.064934:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003540224 00000100:00100000:0.0:1787365271.064943:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003540224 00000100:00100000:0.0:1787365271.064999:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:0.0:1787365271.065008:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2362:x1874188003540224:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:0.0:1787365271.065059:0:6682:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47be4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.065080:0:6682:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb47bc1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989384 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.065089:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365271.065094:0:6682:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:0.0:1787365271.065099:0:6682:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47be4 lrc: 4/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.065131:0:6682:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb47bc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989384 expref: 8 pid: 6681 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.065145:0:6682:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb47bc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989384 expref: 8 pid: 6681 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365271.065160:0:6682:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbbb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1874188024496128:192.168.203.13@tcp:104: 00000100:00100000:0.0:1787365271.065237:0:6682:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473f540 going to sleep for 11 seconds 00000100:00100000:0.0:1787365271.071434:0:6682:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbbb100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_002:lustre-OST0001_UUID:6682:1874188024496128:192.168.203.13@tcp:104: 00010000:00010000:0.0:1787365271.071465:0:6682:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47be4 lrc: 3/1,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365271.073713:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365271.073917:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003540352 00000100:00100000:3.0:1787365271.073928:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003540352 00010000:00010000:3.0:1787365271.073974:0:8434:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb47bc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989384 expref: 9 pid: 6681 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365271.074025:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:3.0:1787365271.074035:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+9:2362:x1874188003540352:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365271.074049:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365271.074070:0:8434:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb47bc1 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989384 expref: 9 pid: 6681 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.074083:0:8434:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb47bc1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989384 expref: 9 pid: 6681 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.074124:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000044b559c6/0x872d29295eb47bc1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x6:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->4095) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989384 expref: 9 pid: 6681 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.074141:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787365271.074146:0:8434:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787365271.074152:0:8434:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47be4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.074162:0:8434:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47be4 lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.074187:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:1.0:1787365271.074203:0:6682:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47be4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365271.074213:0:6682:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47be4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365271.074235:0:6682:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47be4 lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365271.074243:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b64380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2362:x1874188003540352:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 210us (548us total) trans 0 rc 0/0 00010000:00010000:1.0:1787365271.074244:0:6682:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47be4 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365271.074251:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 81 00010000:00010000:1.0:1787365271.074252:0:6682:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47be4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365271.074259:0:6682:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e22800 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365271.074263:0:6682:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47be4 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365271.074272:0:6682:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47be4 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365271.074297:0:6682:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47be4 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365271.074305:0:6682:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47be4 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 6682 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365271.076288:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b65c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2362:x1874188003540224:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 11270us (11440us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365271.076301:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:2.0:1787365271.080224:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365271.087054:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003540608 00000100:00100000:3.0:1787365271.087069:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003540608 00000100:00100000:3.0:1787365271.087146:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 230 00000100:00100000:3.0:1787365271.087156:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+19:11620:x1874188003540608:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:3.0:1787365271.087235:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47beb lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.087253:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47beb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.087264:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47beb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.087479:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47bf2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.087490:0:5833:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47ba5 lrc: 2/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898936f expref: 20 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.087499:0:5833:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47bf2 lrc: 4/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.087536:0:5833:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47ba5 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898936f expref: 20 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.087550:0:5833:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47ba5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898936f expref: 20 pid: 6704 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365271.087564:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6b37b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874188024496256:192.168.203.13@tcp:104: 00000100:00100000:2.0:1787365271.092223:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bcfb9e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787365271.102040:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365271.102194:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003540736 00000100:00100000:0.0:1787365271.102203:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003540736 00010000:00010000:0.0:1787365271.102245:0:5820:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47ba5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898936f expref: 21 pid: 6704 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365271.102285:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:0.0:1787365271.102295:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:2361:x1874188003540736:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787365271.102309:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365271.102315:0:5820:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47ba5 lrc: 5/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898936f expref: 21 pid: 6704 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.102328:0:5820:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47ba5 lrc: 4/0,0 mode: CR/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898936f expref: 21 pid: 6704 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.102349:0:5820:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f27988dfa00) 00010000:00010000:0.0:1787365271.102354:0:5820:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47bf2 lrc: 3/0,1 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.102362:0:5820:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47bf2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.102370:0:5820:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47bf2 lrc: 4/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50290000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365271.102408:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365271.102469:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b34700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:2361:x1874188003540736:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 174us (438us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365271.102477:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 82 00010000:00010000:2.0:1787365271.102856:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47ba5 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898936f expref: 20 pid: 6704 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365271.102873:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6b37b80 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874188024496256:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365271.102892:0:5833:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47bf2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.102908:0:5833:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47bf2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.102914:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47bf2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787365271.103107:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967508 00000001:00080000:2.0:1787365271.103256:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967509 00000001:00080000:2.0:1787365271.103301:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967510 00000100:00100000:2.0:1787365271.103379:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6b67100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874188024496384:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787365271.103428:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365271.103461:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2686c77240 going to sleep for 11 seconds 00000100:00100000:1.0:1787365271.103843:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024496384 00000100:00100000:1.0:1787365271.103850:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024496384 00000100:00100000:1.0:1787365271.103895:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787365271.103904:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1874188024496384:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787365271.103991:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b66300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1874188024496384:12345-0@lo:1000:mdt00_000.0 Request processed in 88us (562us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365271.103998:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787365271.104319:0:5833:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967317 gen 2 00000004:00080000:2.0:1787365271.104326:0:5833:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967317 committed transno 4294967317 00000100:00100000:2.0:1787365271.104347:0:5833:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9f27b6b67b80 x1874188024495744/t4294967321(4294967321) o6->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 544/432 e 0 to 0 dl 1787365286 ref 1 fl Complete:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365271.104359:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6b67100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874188024496384:0@lo:1000:mdt00_000.0 00000001:00080000:2.0:1787365271.105096:0:5833:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967511 00000100:00100000:2.0:1787365271.105173:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6b67100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874188024496512:0@lo:1000:mdt00_000.0 00000100:00100000:2.0:1787365271.105218:0:5833:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365271.105252:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27a5b67540 going to sleep for 11 seconds 00000100:00100000:1.0:1787365271.105390:0:5839:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024496512 00000100:00100000:1.0:1787365271.105396:0:5839:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024496512 00000100:00100000:1.0:1787365271.105481:0:5839:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787365271.105490:0:5839:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+6:5833:x1874188024496512:12345-0@lo:1000:mdt00_000.0 00000100:00100000:1.0:1787365271.105741:0:5839:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b65f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_001:lustre-MDT0000-mdtlov_UUID+7:5833:x1874188024496512:12345-0@lo:1000:mdt00_000.0 Request processed in 241us (511us total) trans 4294967323 rc 0/0 00000100:00100000:1.0:1787365271.105750:0:5839:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787365271.105828:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6b67100 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-mdtlov_UUID:5833:1874188024496512:0@lo:1000:mdt00_000.0 00010000:00010000:2.0:1787365271.105861:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47bf2 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.105872:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47bf2 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.105890:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47bf2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.105897:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365271.105901:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47bf2 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.105909:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47bf2 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.105924:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f27988dfa00) 00010000:00010000:2.0:1787365271.105927:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787365271.105932:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47bf2 lrc: 2/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.105947:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45800/0x872d29295eb47bf2 lrc: 0/0,0 mode: --/EX res: [0x200000401:0x10:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.105974:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23600/0x872d29295eb47b35 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.105980:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23600/0x872d29295eb47b35 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.105986:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23600/0x872d29295eb47b35 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.105991:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e23600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365271.105993:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23600/0x872d29295eb47b35 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.106019:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23600/0x872d29295eb47b35 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.106029:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:2.0:1787365271.106031:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787365271.106038:0:5833:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47b3c lrc: 2/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989353 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.106049:0:5833:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47b3c lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989353 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.106057:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47b3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989353 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.106084:0:5833:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47b3c lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989353 expref: 23 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365271.106095:0:5833:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6b66680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874188024496640:192.168.203.13@tcp:105: 00000100:00100000:2.0:1787365271.106164:0:5833:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2797b01480 going to sleep for 11 seconds 00000100:00100000:3.0:1787365271.111057:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365271.111199:0:5833:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6b66680 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:5833:1874188024496640:192.168.203.13@tcp:105: 00010000:00010000:2.0:1787365271.111225:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23600/0x872d29295eb47b35 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.111236:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e23600/0x872d29295eb47b35 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.111267:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb47bf9 lrc: 3/0,1 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.111293:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb47bf9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.111303:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb47bf9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.111314:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb47bf9 lrc: 3/0,1 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.111320:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb47bf9 lrc: 2/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.111326:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb47bf9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.111332:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709c00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365271.111336:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb47bf9 lrc: 3/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.111343:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb47bf9 lrc: 4/0,0 mode: EX/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.111352:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:2.0:1787365271.111355:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365271.111358:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb47bf9 lrc: 2/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.111364:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb47bf9 lrc: 0/0,0 mode: --/EX res: [0x200000401:0xe:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.111371:0:5833:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47beb lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.111381:0:5833:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47beb lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.111387:0:5833:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47beb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.111392:0:5833:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365271.111395:0:5833:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47beb lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.111401:0:5833:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47beb lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.111409:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:2.0:1787365271.111411:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787365271.111414:0:5833:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47beb lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.111419:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47beb lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365271.111737:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b65500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+23:11620:x1874188003540608:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 24581us (31520us total) trans 4294967512 rc 0/0 00000100:00100000:2.0:1787365271.111747:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 230 00000020:00080000:2.0:1787365271.111752:0:5833:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000100:00100000:0.0:1787365271.111929:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003540864 00000100:00100000:0.0:1787365271.111946:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003540864 00000100:00100000:0.0:1787365271.112006:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 61 00000100:00100000:0.0:1787365271.112029:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+23:11619:x1874188003540864:12345-192.168.203.13@tcp:49:lfs.0 00000100:00100000:0.0:1787365271.112128:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+23:11619:x1874188003540864:12345-192.168.203.13@tcp:49:lfs.0 Request processed in 103us (1080us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365271.112135:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 61 00000040:00080000:3.0:1787365271.112372:0:11664:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787365271.112377:0:11664:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787365271.112404:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 3 00000040:00080000:3.0:1787365271.112409:0:11664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787365271.121032:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365271.121113:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365271.121660:0:11946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003541376 00000100:00100000:2.0:1787365271.121669:0:11946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003541376 00000100:00100000:2.0:1787365271.121731:0:11946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 62 00000100:00100000:2.0:1787365271.121741:0:11946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278ac6e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+23:11620:x1874188003541376:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787365271.122416:0:11946:0:(mdd_object.c:4014:mdd_close()) Object [0x200000401:0x10:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787365271.122522:0:11946:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 4294967513 00010000:00010000:2.0:1787365271.122572:0:11946:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47c00 lrc: 3/0,1 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.122589:0:11946:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47c00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010080000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.122601:0:11946:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47c00 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.122610:0:11946:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47c00 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010080000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.122616:0:11946:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47c00 lrc: 4/0,1 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.122622:0:11946:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47c00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x50010480000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.122679:0:11946:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787365271.122782:0:11946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278ac6e050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+25:11620:x1874188003541376:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 1040us (1666us total) trans 4294967514 rc 0/0 00000100:00100000:2.0:1787365271.122790:0:11946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 62 00000020:00080000:2.0:1787365271.122796:0:11946:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:3.0:1787365271.123056:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365271.123064:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47c00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.123082:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708600 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365271.123086:0:5822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47c00 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40010480000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.123094:0:5822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47c00 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x40018480000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.123108:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x10:0x0].0x0 (ffff9f27988df200) 00010000:00010000:3.0:1787365271.123110:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:3.0:1787365271.123114:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47c00 lrc: 1/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.123120:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47c00 lrc: 0/0,0 mode: --/PW res: [0x200000401:0x10:0x0].0x0 bits 0x40/0x0 rrc: 2 type: IBT flags: 0x44819480000000 pid: 11946 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.123137:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365271.123139:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365271.123141:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365271.123273:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003541120 00000100:00100000:1.0:1787365271.123279:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003541120 00000100:00100000:1.0:1787365271.123324:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 231 00000100:00100000:1.0:1787365271.123333:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+25:11619:x1874188003541120:12345-192.168.203.13@tcp:58:lfs.0 00000040:00080000:1.0:1787365271.123511:0:5834:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x8:0x0].6, 136 off9008 00000100:00100000:1.0:1787365271.123578:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b37b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+25:11619:x1874188003541120:12345-192.168.203.13@tcp:58:lfs.0 Request processed in 246us (2555us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365271.123586:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 231 00000100:00100000:3.0:1787365271.166900:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365271.167029:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003541504 00000100:00100000:2.0:1787365271.167039:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003541504 00000100:00100000:2.0:1787365271.167102:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 232 00000100:00100000:2.0:1787365271.167112:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+25:11622:x1874188003541504:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1787365271.167138:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365271.167170:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb47c07 lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898938b expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.167234:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47c0e lrc: 3/1,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.167247:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47c0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.167258:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47c0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.167272:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47c15 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.167278:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47c15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.167284:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47c15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.167557:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47c1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.167568:0:5835:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22200/0x872d29295eb47b27 lrc: 2/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898934c expref: 26 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.167576:0:5835:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47c1c lrc: 4/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.167606:0:5835:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22200/0x872d29295eb47b27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898934c expref: 26 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.167675:0:5835:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22200/0x872d29295eb47b27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898934c expref: 26 pid: 6704 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365271.167691:0:5835:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6b64700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874188024496768:192.168.203.13@tcp:104: 00000100:00100000:2.0:1787365271.167925:0:5835:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abf94e40 going to sleep for 11 seconds 00000100:00100000:3.0:1787365271.175200:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365271.175331:0:5835:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6b64700 pname:cluuid:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000_UUID:5835:1874188024496768:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365271.175360:0:5835:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47c1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365271.176588:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003541760 00000100:00100000:1.0:1787365271.176599:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003541760 00000100:00100000:1.0:1787365271.176676:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:1.0:1787365271.176686:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+27:5596:x1874188003541760:12345-192.168.203.13@tcp:35:ldlm_bl.0 00000100:00100000:1.0:1787365271.177098:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf92a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+28:5596:x1874188003541760:12345-192.168.203.13@tcp:35:ldlm_bl.0 Request processed in 413us (1907us total) trans 4294967515 rc 0/0 00000100:00100000:1.0:1787365271.177106:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 63 00000100:00100000:1.0:1787365271.182196:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365271.182278:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003541888 00000100:00100000:3.0:1787365271.182287:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003541888 00010000:00010000:3.0:1787365271.182325:0:8435:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22200/0x872d29295eb47b27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898934c expref: 28 pid: 6704 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365271.182370:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:3.0:1787365271.182380:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb408380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+28:2361:x1874188003541888:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365271.182394:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365271.182401:0:8435:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22200/0x872d29295eb47b27 lrc: 4/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898934c expref: 28 pid: 6704 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.182427:0:8435:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22200/0x872d29295eb47b27 lrc: 3/0,0 mode: CW/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898934c expref: 28 pid: 6704 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.182447:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22200/0x872d29295eb47b27 lrc: 0/0,0 mode: --/CW res: [0x200000401:0xe:0x0].0x0 bits 0x5/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898934c expref: 28 pid: 6704 timeout: 488 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.182463:0:8435:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:3.0:1787365271.182467:0:8435:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47c1c lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x13/0x48 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.182477:0:8435:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47c1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.182484:0:8435:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47c1c lrc: 4/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 4 type: IBT flags: 0x40290000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365271.182515:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365271.182572:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb408380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+27:2361:x1874188003541888:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 193us (385us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365271.182580:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 83 00010000:00010000:2.0:1787365271.182602:0:5835:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47c1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.182613:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47c1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365271.182675:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00000004:00200000:2.0:1787365271.182679:0:5835:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365271.182695:0:5835:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47c1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.182706:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47c1c lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.182715:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47c0e lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.182721:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47c0e lrc: 2/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.182742:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47c0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.182749:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365271.182756:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47c0e lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.182764:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47c0e lrc: 4/0,0 mode: CR/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.182774:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:2.0:1787365271.182777:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365271.182781:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47c0e lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.182787:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47c0e lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.182798:0:5835:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47c15 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.182805:0:5835:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47c15 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.182811:0:5835:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47c15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.182816:0:5835:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365271.182819:0:5835:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47c15 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.182833:0:5835:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47c15 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.182841:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x719e0b09 (ffff9f27988dfa00) 00010000:00010000:2.0:1787365271.182844:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365271.182847:0:5835:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47c15 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.182853:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47c15 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x719e0b09 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.182884:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709c00/0x872d29295eb47c07 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898938b expref: 27 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.182897:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47c1c lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898938b expref: 26 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365271.182903:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:2.0:1787365271.182905:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787365271.182908:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb708600, rc 0) 00000100:00100000:2.0:1787365271.182931:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b35f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+26:11622:x1874188003541504:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 15821us (16041us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365271.182938:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 232 00010000:00010000:2.0:1787365271.922937:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787365272.001188:0:12553:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787365272.001197:0:12553:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787365272.001239:0:12553:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:1.0:1787365272.001244:0:12553:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000040:00080000:2.0:1787365272.119550:0:11664:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787365272.119559:0:11664:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787365272.119608:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:2.0:1787365272.119616:0:11664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:2.0:1787365272.120136:0:11664:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6b64700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11664:1874188024496896:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787365272.120227:0:11664:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278ae67cc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787365272.126976:0:11664:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6b64700 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:11664:1874188024496896:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:0.0:1787365272.144324:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365272.147360:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003542016 00000100:00100000:1.0:1787365272.147374:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003542016 00000100:00100000:0.0:1787365272.147516:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 233 00000100:00100000:0.0:1787365272.147528:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+26:11634:x1874188003542016:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:0.0:1787365272.147563:0:5834:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000401:0xe:0x0] from 18446744073709551615 #0 00000100:00100000:0.0:1787365272.147716:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbbb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+26:11634:x1874188003542016:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 189us (3398us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365272.147938:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 233 00000100:00080000:1.0:1787365272.148224:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365272.156582:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365272.156662:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003542272 00000100:00100000:3.0:1787365272.156671:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003542272 00000100:00100000:2.0:1787365272.157118:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 234 00000100:00100000:2.0:1787365272.157132:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+26:11634:x1874188003542272:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365272.157151:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365272.157168:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47c23 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989392 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365272.157256:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47c2a lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365272.157270:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365272.157282:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47c2a lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365272.157291:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:2.0:1787365272.157400:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709200/0x872d29295eb47c23 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989392 expref: 29 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365272.157414:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47c2a lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989392 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365272.157423:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:2.0:1787365272.157426:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:2.0:1787365272.157439:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb708a00, rc 0) 00000100:00100000:2.0:1787365272.157499:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b64700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+28:11634:x1874188003542272:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 372us (927us total) trans 4294967516 rc 0/0 00000100:00100000:2.0:1787365272.158831:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 234 00000100:00100000:1.0:1787365272.165171:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365272.166495:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003542400 00000100:00100000:3.0:1787365272.166507:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003542400 00000100:00100000:3.0:1787365272.166572:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:3.0:1787365272.166582:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb40b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+28:2362:x1874188003542400:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365272.166597:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365272.166622:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708a00/0x872d29295eb47c2a lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989392 expref: 28 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365272.166677:0:8434:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:3.0:1787365272.166682:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365272.175902:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365272.177665:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003542656 00000100:00100000:1.0:1787365272.177677:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003542656 00000100:00100000:1.0:1787365272.177893:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 235 00000100:00100000:1.0:1787365272.177905:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+28:11634:x1874188003542656:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:1.0:1787365272.177984:0:6704:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47c38 lrc: 3/0,1 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365272.178001:0:6704:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47c38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365272.178036:0:6704:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47c38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365272.178210:0:6704:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47c38 lrc: 3/0,1 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365272.178218:0:6704:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47c38 lrc: 2/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365272.178225:0:6704:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47c38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365272.178229:0:6704:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798115e00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365272.178233:0:6704:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47c38 lrc: 3/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365272.178240:0:6704:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47c38 lrc: 4/0,0 mode: PW/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365272.178251:0:6704:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:1.0:1787365272.178254:0:6704:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:1.0:1787365272.178259:0:6704:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47c38 lrc: 2/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365272.178265:0:6704:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb47c38 lrc: 0/0,0 mode: --/PW res: [0x200000401:0xe:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 6704 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365272.178393:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbbad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+29:11634:x1874188003542656:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 490us (2498us total) trans 4294967517 rc 0/0 00000100:00100000:1.0:1787365272.178401:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 235 00000040:00080000:1.0:1787365272.178501:0:11664:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:1.0:1787365272.178505:0:11664:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:1.0:1787365272.179234:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 64768 count 4 00000040:00080000:1.0:1787365272.179245:0:11664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:3.0:1787365272.183084:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb40b100 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+28:2362:x1874188003542400:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 16492us (17910us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365272.183099:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:3.0:1787365272.196357:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365272.206916:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003542912 00000100:00100000:1.0:1787365272.206929:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003542912 00000100:00100000:1.0:1787365272.206986:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 64 00000100:00100000:1.0:1787365272.206997:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+28:11634:x1874188003542912:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787365272.207232:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+29:11634:x1874188003542912:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 236us (10884us total) trans 4294967518 rc 0/0 00000100:00100000:1.0:1787365272.207240:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 64 00010000:00010000:3.0:1787365272.947615:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:3.0:1787365273.952621:0:12604:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:3.0:1787365273.952814:0:12604:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787365273.952867:0:12604:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 4 00000040:00080000:3.0:1787365273.952873:0:12604:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00000100:00100000:0.0:1787365273.976058:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365273.976092:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365273.976116:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365273.976146:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365273.976171:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365273.976239:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003543040 00000100:00100000:0.0:1787365273.976259:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003543040 00000100:00100000:0.0:1787365273.976310:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 302 00000100:00100000:0.0:1787365273.976319:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2359:x1874188003543040:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365273.976383:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795f450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2359:x1874188003543040:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 65us (332us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365273.976391:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 302 00000100:00100000:0.0:1787365273.976422:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003543296 00000100:00100000:0.0:1787365273.976431:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003543296 00000100:00100000:0.0:1787365273.976467:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003543424 00000100:00100000:0.0:1787365273.976471:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003543424 00000100:00100000:0.0:1787365273.976545:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:0.0:1787365273.976553:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2359:x1874188003543296:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365273.976580:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbb8e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2359:x1874188003543296:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 29us (487us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365273.976587:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:0.0:1787365273.976598:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:0.0:1787365273.976603:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2359:x1874188003543424:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365273.976651:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2359:x1874188003543424:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 46us (477us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365273.976659:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:0.0:1787365273.976679:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003543552 00000100:00100000:0.0:1787365273.976683:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003543552 00000100:00100000:0.0:1787365273.976707:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003543168 00000100:00100000:0.0:1787365273.976710:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003543168 00000100:00100000:0.0:1787365273.976732:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 173 00000100:00100000:0.0:1787365273.976738:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2359:x1874188003543552:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365273.976778:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f3100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2359:x1874188003543552:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 40us (661us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365273.976785:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 173 00000100:00100000:0.0:1787365273.976797:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 174 00000100:00100000:0.0:1787365273.976804:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+29:2359:x1874188003543168:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365273.976835:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f1500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+29:2359:x1874188003543168:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 32us (688us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365273.976842:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 174 00010000:00010000:0.0:1787365273.976873:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787365273.978197:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787365273.978204:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787365273.978207:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:3.0:1787365274.218420:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365274.218582:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003543808 00000100:00100000:0.0:1787365274.218595:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003543808 00000100:00100000:0.0:1787365274.218730:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 236 00000100:00100000:0.0:1787365274.218742:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+29:11655:x1874188003543808:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1787365274.218769:0:5835:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365274.218794:0:5835:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22200/0x872d29295eb47c3f lrc: 2/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989399 expref: -99 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:2.0:1787365274.218910:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:0.0:1787365274.218923:0:5835:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22e00/0x872d29295eb47c46 lrc: 3/1,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365274.218945:0:5835:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22e00/0x872d29295eb47c46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365274.218960:0:5835:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22e00/0x872d29295eb47c46 lrc: 3/1,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5835 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365274.219033:0:5835:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000401:0xe:0x0]: returning size 0 00010000:00010000:0.0:1787365274.219197:0:5835:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22200/0x872d29295eb47c3f lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989399 expref: 32 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365274.219220:0:5835:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22e00/0x872d29295eb47c46 lrc: 3/0,0 mode: CR/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989399 expref: 31 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365274.219230:0:5835:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:0.0:1787365274.219234:0:5835:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787365274.219238:0:5835:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27b6e22e00, rc 0) 00000100:00100000:0.0:1787365274.219315:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f1c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+31:11655:x1874188003543808:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 575us (910us total) trans 4294967519 rc 0/0 00000100:00100000:0.0:1787365274.219324:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 236 00000100:00100000:0.0:1787365274.231151:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365274.231275:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003543936 00000100:00100000:1.0:1787365274.231293:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003543936 00000100:00100000:1.0:1787365274.231387:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 237 00000100:00100000:1.0:1787365274.231400:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bf0f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+31:11655:x1874188003543936:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:1.0:1787365274.231797:0:5834:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb47c54 lrc: 3/1,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365274.231820:0:5834:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb47c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365274.231835:0:5834:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb47c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365274.231869:0:5834:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb47c54 lrc: 3/1,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365274.231877:0:5834:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb47c54 lrc: 2/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365274.231907:0:5834:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb47c54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365274.231914:0:5834:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798115600 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365274.231918:0:5834:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb47c54 lrc: 3/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365274.231927:0:5834:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb47c54 lrc: 4/0,0 mode: PR/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365274.231941:0:5834:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:1.0:1787365274.231945:0:5834:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:1.0:1787365274.231951:0:5834:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb47c54 lrc: 2/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365274.231958:0:5834:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115600/0x872d29295eb47c54 lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 5834 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365274.232212:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bf0f3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+31:11655:x1874188003543936:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 811us (1066us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365274.232222:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 237 00000100:00100000:2.0:1787365274.352664:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365274.352895:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003544064 00000100:00100000:0.0:1787365274.352910:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003544064 00000100:00100000:0.0:1787365274.352999:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:0.0:1787365274.353019:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2361:x1874188003544064:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:0.0:1787365274.353051:0:10260:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365274.353080:0:10260:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47c5b lrc: 2/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989893a0 expref: -99 pid: 10260 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787365274.353115:0:10260:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x6:0x0] initial LVB size: 13, mtime: 0x6a890795, atime: 0x6a890794, ctime: 0x6a890795, blocks: 0xb 00010000:00010000:0.0:1787365274.353140:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=391s v=(0 0) 00010000:00010000:0.0:1787365274.353146:0:10260:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365274.353158:0:10260:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47c5b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989893a0 expref: 8 pid: 10260 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365274.353201:0:10260:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47c5b lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989893a0 expref: 8 pid: 10260 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365274.353219:0:10260:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27b6e22200, rc 0) 00000100:00100000:0.0:1787365274.353308:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b66680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2361:x1874188003544064:12345-192.168.203.13@tcp:101:cat.0 Request processed in 292us (710us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365274.353315:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 70 00000100:00100000:2.0:1787365274.362121:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365274.362234:0:6686:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003544192 00000100:00100000:3.0:1787365274.362245:0:6686:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003544192 00002000:00100000:3.0:1787365274.362296:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9f27bb732a00 x1874188003544192/t0(0) o3->8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp:180/0 lens 488/0 e 0 to 0 dl 1787365285 ref 1 fl New:/600/ffffffff rc 0/-1 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787365274.362308:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f27bb732a00 with x1874188003544192 ext(0->4095) 00002000:00010000:3.0:1787365274.362313:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f27bb732a00 00000100:00100000:3.0:1787365274.362405:0:6686:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1787365274.362417:0:6686:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb732a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2362:x1874188003544192:12345-192.168.203.13@tcp:3:cat.0 00000100:00100000:3.0:1787365274.362666:0:6686:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb732a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+8:2362:x1874188003544192:12345-192.168.203.13@tcp:3:cat.0 Request processed in 250us (553us total) trans 0 rc 4096/4096 00000100:00100000:3.0:1787365274.362674:0:6686:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00002000:00100000:3.0:1787365274.362681:0:6686:0:(ofd_dev.c:2711:ofd_rw_hpreq_check()) @@@ lustre-OST0001 ll_ost_io00_000: refresh rw locks for [0x280000400:0x6:0x0] (0->4095) req@ffff9f27bb732a00 x1874188003544192/t0(0) o3->8662a6a5-8ae3-4336-8479-3ba18dbc45ca@192.168.203.13@tcp:180/0 lens 488/4536 e 0 to 0 dl 1787365285 ref 1 fl Complete:/600/0 rc 4096/4096 job:'cat.0' uid:0 gid:0 projid:0 00002000:00100000:3.0:1787365274.362725:0:6686:0:(ofd_dev.c:2567:ofd_prolong_extent_locks()) Prolong locks for req ffff9f27bb732a00 with x1874188003544192 ext(0->4095) 00002000:00010000:3.0:1787365274.362728:0:6686:0:(ofd_dev.c:2716:ofd_rw_hpreq_check()) lustre-OST0001: refreshed 0 locks timeout for req ffff9f27bb732a00 00000100:00100000:1.0:1787365274.485720:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024497024:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787365274.485805:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365274.489270:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024497024 00000100:00100000:2.0:1787365274.489284:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024497024 00000100:00100000:2.0:1787365274.489393:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 77 00000100:00100000:2.0:1787365274.489405:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb40b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874188024497024:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787365274.489448:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365274.489536:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb40b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874188024497024:12345-0@lo:13:osp-pre-0-0.0 Request processed in 133us (3729us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365274.489543:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 77 00000100:00080000:0.0:1787365274.489839:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787365274.490053:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb730000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024497024:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787365274.995070:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:0.0:1787365275.080467:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 4294967310 is committed 00000100:00100000:0.0:1787365275.507672:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024497536:0@lo:400:kworker.0 00000100:00100000:0.0:1787365275.507777:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365275.507857:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787365275.507864:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024497152:0@lo:400:kworker.0 00000100:00100000:0.0:1787365275.507893:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365275.507930:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb3c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874188024497664:0@lo:400:kworker.0 00000100:00100000:0.0:1787365275.507956:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365275.507992:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb40ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024497280:0@lo:400:kworker.0 00000100:00100000:0.0:1787365275.508016:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365275.508035:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024497792:0@lo:400:kworker.0 00000100:00100000:0.0:1787365275.508055:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365275.508070:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787365275.508075:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024497408:0@lo:400:kworker.0 00000100:00100000:0.0:1787365275.508093:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365275.508148:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024497152 00000100:00100000:0.0:1787365275.508156:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024497152 00000100:00100000:0.0:1787365275.508209:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787365275.508218:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024497152:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365275.508273:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795f050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024497152:12345-0@lo:400:kworker.0 Request processed in 56us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365275.508280:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 303 00000100:00100000:0.0:1787365275.508314:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024497664 00000100:00100000:0.0:1787365275.508317:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024497664 00000100:00100000:0.0:1787365275.508609:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024497280 00000100:00100000:0.0:1787365275.508613:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024497280 00000100:00100000:0.0:1787365275.508652:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024497408 00000100:00100000:0.0:1787365275.508655:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024497408 00000100:00100000:0.0:1787365275.508669:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787365275.508674:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874188024497664:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365275.508712:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaae680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874188024497664:12345-0@lo:400:kworker.0 Request processed in 38us (755us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365275.508718:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 175 00000100:00100000:0.0:1787365275.508728:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787365275.508734:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024497280:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365275.508760:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaad880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024497280:12345-0@lo:400:kworker.0 Request processed in 27us (743us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365275.508818:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 176 00000100:00100000:0.0:1787365275.508829:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787365275.508835:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024497408:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365275.508860:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaad500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024497408:12345-0@lo:400:kworker.0 Request processed in 26us (767us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365275.508877:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 177 00000100:00100000:0.0:1787365275.508960:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024497536 00000100:00100000:0.0:1787365275.508964:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024497536 00000100:00100000:0.0:1787365275.508999:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024497792 00000100:00100000:0.0:1787365275.509002:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024497792 00000100:00100000:0.0:1787365275.509026:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787365275.509031:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024497536:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365275.509064:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024497536:12345-0@lo:400:kworker.0 Request processed in 33us (1288us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365275.509069:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 91 00000100:00100000:0.0:1787365275.509079:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 92 00000100:00100000:0.0:1787365275.509085:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1874188024497792:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365275.509111:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaadc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+7:3312:x1874188024497792:12345-0@lo:400:kworker.0 Request processed in 27us (1056us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365275.509117:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 92 00000100:00080000:0.0:1787365275.509140:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787365275.509145:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365275.509188:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024497408:0@lo:400:kworker.0 00000100:00100000:0.0:1787365275.509199:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb40ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024497280:0@lo:400:kworker.0 00000100:00100000:0.0:1787365275.509210:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6c45180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024497792:0@lo:400:kworker.0 00000100:00100000:0.0:1787365275.509243:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024497152:0@lo:400:kworker.0 00000100:00100000:0.0:1787365275.509252:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c2d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874188024497664:0@lo:400:kworker.0 00000100:00100000:0.0:1787365275.509260:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 2 00000004:00080000:0.0:1787365275.509266:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f27bb409c00, transno 4294967310 00000100:00100000:0.0:1787365275.509285:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb3c1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024497536:0@lo:400:kworker.0 00000004:00080000:3.0:1787365275.513312:0:8089:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 392677683806ns, next at 393677680431ns, rc = 0 00000100:00100000:0.0:1787365275.513457:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024497920:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787365275.513555:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365275.513853:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024497920 00000100:00100000:3.0:1787365275.513862:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024497920 00000100:00100000:3.0:1787365275.513933:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787365275.513943:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874188024497920:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787365275.513994:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365275.514050:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaad180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3313:x1874188024497920:12345-0@lo:13:osp-pre-1-0.0 Request processed in 108us (495us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365275.514059:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 78 00000100:00100000:3.0:1787365275.514109:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024497920:0@lo:13:osp-pre-1-0.0 00010000:00010000:0.0:1787365276.022270:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:2.0:1787365276.131433:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967321 is committed 00000001:00080000:2.0:1787365276.131457:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967323 is committed 00000001:00080000:2.0:1787365276.131464:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967322 is committed 00000001:00080000:0.0:1787365276.140859:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967519 is committed 00000020:00080000:0.0:1787365276.140892:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 7 batchid updated 00000020:00080000:0.0:1787365276.140932:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f2686c77180 refcount 2 committed 0 result 0 batchid 8 00000020:00080000:0.0:1787365276.140937:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f27bb70cb00 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f2686c77240 00000020:00080000:0.0:1787365276.140941:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f27bb70c100 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f27bb30b800 00000004:00080000:0.0:1787365276.140955:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 11 committed 00000100:00100000:3.0:1787365276.141114:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787365276.141141:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024498048:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787365276.141234:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365276.141388:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024498048 00000100:00100000:0.0:1787365276.141397:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024498048 00000100:00100000:0.0:1787365276.141457:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:0.0:1787365276.141467:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024498048:12345-0@lo:2:osp-syn-1-0.0 00002000:00010000:0.0:1787365276.141845:0:6682:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb size from disk: 13 -> 13 00002000:00010000:0.0:1787365276.141850:0:6682:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb mtime from disk: 1787365269 -> 1787365269 00002000:00010000:0.0:1787365276.141853:0:6682:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb atime from disk: 1787365268 -> 1787365268 00002000:00010000:0.0:1787365276.141855:0:6682:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb ctime from disk: 1787365269 -> 1787365269 00002000:00010000:0.0:1787365276.141857:0:6682:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x6:0x0] updating lvb blocks from disk: 11 -> 11 00000020:00080000:2.0:1787365276.142004:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 8 committed batchid 7 00000020:00080000:2.0:1787365276.142190:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 7 00000100:00100000:0.0:1787365276.142809:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+6:3311:x1874188024498048:12345-0@lo:2:osp-syn-1-0.0 Request processed in 1338us (1569us total) trans 4294967324 rc 0/0 00000100:00100000:0.0:1787365276.142820:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787365276.142988:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967323 gen 2 00000004:00080000:3.0:1787365276.142995:0:3311:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f27b6b67b80, transno 4294967321 00000004:00080000:3.0:1787365276.143014:0:3311:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 4294967323 committed transno 4294967323 00000100:00100000:3.0:1787365276.143045:0:3311:0:(client.c:3169:ptlrpc_free_committed()) @@@ stopping search req@ffff9f27bb2f0380 x1874188024498048/t4294967324(4294967324) o2->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 440/432 e 0 to 0 dl 1787365292 ref 2 fl Rpc:RQU/204/0 rc 0/0 job:'osp-syn-1-0.0' uid:0 gid:0 projid:4294967295 00000004:00080000:3.0:1787365276.143060:0:3311:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f27bb2f0380/2, rc 0, transno 4294967324 00000100:00100000:3.0:1787365276.143066:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024498048:0@lo:2:osp-syn-1-0.0 00010000:00010000:2.0:1787365277.044414:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365278.068722:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365279.089738:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365279.089780:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365279.089869:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365279.089892:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365279.089917:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365279.089952:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003544576 00000100:00100000:3.0:1787365279.089973:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003544576 00000100:00100000:3.0:1787365279.090028:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003544704 00000100:00100000:3.0:1787365279.090031:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003544704 00000100:00100000:3.0:1787365279.090057:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:3.0:1787365279.090067:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2360:x1874188003544576:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365279.090137:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c7b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2360:x1874188003544576:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 71us (355us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365279.090144:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:3.0:1787365279.090162:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:3.0:1787365279.090169:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2360:x1874188003544704:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365279.090195:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be4000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2360:x1874188003544704:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (277us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365279.090201:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:3.0:1787365279.090219:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003544832 00000100:00100000:3.0:1787365279.090222:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003544832 00000100:00100000:3.0:1787365279.090249:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003544448 00000100:00100000:3.0:1787365279.090252:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003544448 00000100:00100000:3.0:1787365279.090273:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 178 00000100:00100000:3.0:1787365279.090279:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2360:x1874188003544832:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365279.090359:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b67b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2360:x1874188003544832:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 79us (489us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365279.090366:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 178 00000100:00100000:3.0:1787365279.090388:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 179 00000100:00100000:3.0:1787365279.090394:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:2360:x1874188003544448:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365279.090397:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003544320 00000100:00100000:1.0:1787365279.090401:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003544320 00000100:00100000:3.0:1787365279.090420:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b67100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:2360:x1874188003544448:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (528us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365279.090426:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 179 00000100:00100000:1.0:1787365279.090428:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 304 00000100:00100000:1.0:1787365279.090434:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2360:x1874188003544320:12345-192.168.203.13@tcp:400:kworker.0 00000100:00080000:3.0:1787365279.090449:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787365279.090453:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787365279.090455:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787365279.090469:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795dc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2360:x1874188003544320:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 35us (741us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365279.090474:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 304 00010000:00010000:3.0:1787365279.097662:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365279.604513:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787365279.604535:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024498176:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787365279.604604:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365279.604933:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024498176 00000100:00100000:2.0:1787365279.604941:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024498176 00000100:00100000:2.0:1787365279.605013:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 79 00000100:00100000:2.0:1787365279.605023:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024498176:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787365279.605056:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365279.605111:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaaca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024498176:12345-0@lo:13:osp-pre-0-0.0 Request processed in 90us (508us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365279.605131:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 79 00000100:00100000:1.0:1787365279.605221:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb733800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024498176:0@lo:13:osp-pre-0-0.0 00000100:00080000:3.0:1787365279.605324:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787365279.705740:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365279.705996:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003544960 00000100:00100000:3.0:1787365279.706005:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003544960 00000100:00100000:3.0:1787365279.706073:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 238 00000100:00100000:3.0:1787365279.706083:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:11299:x1874188003544960:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 00000100:00100000:3.0:1787365279.706203:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb730a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:11299:x1874188003544960:12345-192.168.203.13@tcp:60:lhsmtool_posix.0 Request processed in 121us (472us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365279.706211:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 238 00000100:00100000:3.0:1787365279.708614:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365279.710977:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003545216 00000100:00100000:1.0:1787365279.710991:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003545216 00000100:00100000:1.0:1787365279.711062:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:1.0:1787365279.711072:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:11299:x1874188003545216:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787365279.711564:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+19:11299:x1874188003545216:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 493us (2958us total) trans 4294967520 rc 0/0 00000100:00100000:1.0:1787365279.711572:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 65 00000100:00100000:1.0:1787365279.944126:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365279.944251:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003545344 00000100:00100000:3.0:1787365279.944260:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003545344 00000100:00100000:3.0:1787365279.944319:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 239 00000100:00100000:3.0:1787365279.944329:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:12107:x1874188003545344:12345-192.168.203.13@tcp:101:lsof.0 00010000:00010000:3.0:1787365279.944348:0:5833:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365279.944411:0:5833:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47c62 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989893a7 expref: -99 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365279.944470:0:5833:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47c69 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365279.944496:0:5833:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47c69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365279.944510:0:5833:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47c69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365279.944743:0:5833:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787365279.944747:0:5833:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787365279.944830:0:5833:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47c69 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 5833 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365279.944857:0:5833:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44200/0x872d29295eb47c62 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989893a7 expref: 7 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365279.944874:0:5833:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47c69 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989893a7 expref: 6 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365279.944883:0:5833:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f27988dfc00) 00010000:00010000:3.0:1787365279.944886:0:5833:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787365279.944889:0:5833:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45a00, rc 0) 00000100:00100000:3.0:1787365279.945065:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6c45180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:c868fdb9-61c7-472a-bd37-21cfd41249aa+6:12107:x1874188003545344:12345-192.168.203.13@tcp:101:lsof.0 Request processed in 737us (948us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365279.945073:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 239 00010000:00010000:1.0:1787365280.118095:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365280.627192:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb55b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874188024498432:0@lo:400:kworker.0 00000100:00100000:2.0:1787365280.627192:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb558000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024498304:0@lo:400:kworker.0 00000100:00100000:1.0:1787365280.627269:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024498560:0@lo:400:kworker.0 00000100:00100000:0.0:1787365280.628287:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024498688:0@lo:400:kworker.0 00000100:00100000:2.0:1787365280.632025:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365280.632090:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024498816:0@lo:400:kworker.0 00000100:00100000:2.0:1787365280.632127:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365280.632483:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024498304 00000100:00100000:2.0:1787365280.632492:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024498304 00000100:00100000:1.0:1787365280.632525:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365280.632537:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 305 00000100:00100000:2.0:1787365280.632545:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024498304:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365280.632563:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbaaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024499072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365280.632589:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365280.632597:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795c850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024498304:12345-0@lo:400:kworker.0 Request processed in 53us (579us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365280.632604:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 305 00000100:00100000:1.0:1787365280.632622:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024498816 00000100:00100000:1.0:1787365280.632639:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024498816 00000100:00100000:2.0:1787365280.632653:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024498560 00000100:00100000:2.0:1787365280.632657:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024498560 00000100:00100000:2.0:1787365280.632681:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 180 00000100:00100000:2.0:1787365280.632687:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024498560:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365280.632687:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 181 00000100:00100000:1.0:1787365280.632693:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024498816:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365280.632719:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb733b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024498816:12345-0@lo:400:kworker.0 Request processed in 26us (591us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365280.632720:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb841880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024498560:12345-0@lo:400:kworker.0 Request processed in 34us (196us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365280.632725:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 181 00000100:00080000:1.0:1787365280.632763:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365280.632774:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024499072 00000100:00100000:1.0:1787365280.632777:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024499072 00000100:00100000:1.0:1787365280.632804:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 80 00000100:00100000:1.0:1787365280.632811:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874188024499072:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787365280.632848:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365280.633233:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 180 00000100:00100000:1.0:1787365280.633335:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb840a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3310:x1874188024499072:12345-0@lo:13:osp-pre-1-0.0 Request processed in 523us (744us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365280.633342:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 80 00000100:00080000:1.0:1787365280.633360:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787365280.633413:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbaaea00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024499072:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365280.633424:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024498560:0@lo:400:kworker.0 00000100:00100000:3.0:1787365280.634040:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365280.634068:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024498944:0@lo:400:kworker.0 00000100:00100000:3.0:1787365280.634096:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365280.634220:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024498432 00000100:00100000:1.0:1787365280.634225:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024498432 00000100:00100000:1.0:1787365280.634258:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787365280.634266:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874188024498432:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365280.634305:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6cb3800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874188024498432:12345-0@lo:400:kworker.0 Request processed in 40us (266us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365280.634312:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 182 00000100:00100000:1.0:1787365280.634342:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024498944 00000100:00100000:1.0:1787365280.634346:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024498944 00000100:00100000:1.0:1787365280.634367:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 95 00000100:00100000:1.0:1787365280.634373:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1874188024498944:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365280.634402:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3313:x1874188024498944:12345-0@lo:400:kworker.0 Request processed in 29us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365280.634408:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 95 00000100:00100000:3.0:1787365280.634479:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6cb3b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024498944:0@lo:400:kworker.0 00000100:00100000:3.0:1787365280.634498:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb55b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874188024498432:0@lo:400:kworker.0 00000100:00100000:0.0:1787365280.634762:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365280.638118:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb558000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024498304:0@lo:400:kworker.0 00000100:00100000:2.0:1787365280.638145:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63b0700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024498816:0@lo:400:kworker.0 00000100:00100000:3.0:1787365280.638851:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024498688 00000100:00100000:3.0:1787365280.638859:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024498688 00000100:00100000:3.0:1787365280.639009:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 96 00000100:00100000:3.0:1787365280.639018:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024498688:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365280.639111:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaace00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024498688:12345-0@lo:400:kworker.0 Request processed in 94us (4349us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365280.639242:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63b0380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024498688:0@lo:400:kworker.0 00000100:00100000:3.0:1787365280.639302:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 96 00010000:00010000:3.0:1787365281.138852:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787365281.193456:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 4294967324 is committed 00000001:00080000:0.0:1787365281.195123:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967520 is committed 00000020:00080000:0.0:1787365281.195134:0:5855:0:(update_trans.c:1349:distribute_txn_batchid_cb()) lustre-MDT0000: 8 batchid updated 00000020:00080000:1.0:1787365281.195189:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000020:00080000:1.0:1787365281.195199:0:5866:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1787365281.394895:0:11664:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787365281.394905:0:11664:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787365281.395237:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 7 count 3 00000040:00080000:2.0:1787365281.395243:0:11664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:1.0:1787365282.164358:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365283.188270:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:0.0:1787365283.223194:0:12809:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: == sanity-pcc test 1c: Test automated attach using Project ID with manual HSM restore ========================================================== 22:21:21 (1787365281) 00010000:00010000:1.0:1787365284.212291:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365284.213723:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365284.213764:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365284.213794:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365284.213812:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365284.213837:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365284.214520:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003545600 00000100:00100000:3.0:1787365284.214535:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003545600 00000100:00100000:3.0:1787365284.214610:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003545984 00000100:00100000:3.0:1787365284.214614:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003545984 00000100:00100000:3.0:1787365284.214659:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 183 00000100:00100000:3.0:1787365284.214672:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbaaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:2360:x1874188003545600:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365284.214777:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbaaea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:2360:x1874188003545600:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 107us (1062us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365284.214785:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 183 00000100:00100000:3.0:1787365284.214804:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 184 00000100:00100000:3.0:1787365284.214810:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c868fdb9-61c7-472a-bd37-21cfd41249aa+6:2360:x1874188003545984:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365284.214833:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb409c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c868fdb9-61c7-472a-bd37-21cfd41249aa+6:2360:x1874188003545984:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 24us (996us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365284.214839:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 184 00000100:00100000:1.0:1787365284.215043:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003545856 00000100:00100000:1.0:1787365284.215048:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003545856 00000100:00100000:1.0:1787365284.215091:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003545728 00000100:00100000:1.0:1787365284.215094:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003545728 00000100:00100000:1.0:1787365284.215120:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:1.0:1787365284.215128:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2360:x1874188003545856:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365284.215160:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c1c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2360:x1874188003545856:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 33us (1395us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365284.215167:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:1.0:1787365284.215182:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:1.0:1787365284.215188:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2360:x1874188003545728:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365284.215211:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb3c2d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2360:x1874188003545728:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 23us (1397us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365284.215217:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:1.0:1787365284.215237:0:5829:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003545472 00000100:00100000:1.0:1787365284.215241:0:5829:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003545472 00000100:00100000:1.0:1787365284.215267:0:5829:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 306 00000100:00100000:1.0:1787365284.215274:0:5829:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2360:x1874188003545472:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365284.215301:0:5829:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795f850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2360:x1874188003545472:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 28us (1506us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365284.215307:0:5829:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 306 00000100:00080000:2.0:1787365284.215618:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787365284.215645:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787365284.215648:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365284.723675:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787365284.723705:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024499200:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787365284.723799:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365284.723895:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024499200 00000100:00100000:1.0:1787365284.723905:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024499200 00000100:00080000:2.0:1787365284.723964:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787365284.723993:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787365284.724003:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024499200:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787365284.724052:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 51052544 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365284.724103:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb843100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024499200:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (304us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365284.724111:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 81 00000100:00100000:1.0:1787365284.724169:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb843800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024499200:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787365285.235315:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365285.747096:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb40ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024499584:0@lo:400:kworker.0 00000100:00100000:0.0:1787365285.747163:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365285.747223:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2686970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024500096:0@lo:400:kworker.0 00000100:00100000:0.0:1787365285.747263:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365285.747296:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787365285.747303:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024499712:0@lo:400:kworker.0 00000100:00100000:0.0:1787365285.747325:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365285.747343:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024499328:0@lo:400:kworker.0 00000100:00100000:0.0:1787365285.747355:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024499584 00000100:00100000:0.0:1787365285.747361:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024499584 00000100:00100000:2.0:1787365285.747375:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365285.747397:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2686972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024499840:0@lo:400:kworker.0 00000100:00100000:0.0:1787365285.747397:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024499712 00000100:00100000:0.0:1787365285.747399:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024499712 00000100:00100000:2.0:1787365285.747417:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365285.747425:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787365285.747433:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2686970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024499584:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365285.747479:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2788f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024499456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365285.747509:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365285.747527:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2686973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024499968:0@lo:400:kworker.0 00000100:00100000:1.0:1787365285.747559:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365285.747580:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024499968 00000100:00100000:1.0:1787365285.747584:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024499968 00000100:00100000:1.0:1787365285.747602:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787365285.747609:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024499712:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365285.747675:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798099180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024499712:12345-0@lo:400:kworker.0 Request processed in 66us (348us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365285.747682:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 186 00000100:00100000:1.0:1787365285.747698:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787365285.747704:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024499968:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365285.747735:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb843b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024499968:12345-0@lo:400:kworker.0 Request processed in 32us (176us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365285.747754:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 187 00000100:00100000:1.0:1787365285.747777:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024499456 00000100:00100000:1.0:1787365285.747781:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024499456 00000100:00100000:1.0:1787365285.747805:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 82 00000100:00100000:1.0:1787365285.747812:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024499456:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787365285.747838:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365285.747868:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb843800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024499456:12345-0@lo:13:osp-pre-1-0.0 Request processed in 56us (358us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365285.747875:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 82 00000100:00100000:0.0:1787365285.748142:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2686970380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024499584:12345-0@lo:400:kworker.0 Request processed in 708us (978us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365285.748148:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 185 00000100:00100000:0.0:1787365285.748169:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024500096 00000100:00100000:0.0:1787365285.748179:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024500096 00000100:00100000:0.0:1787365285.748204:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024499840 00000100:00100000:0.0:1787365285.748207:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024499840 00000100:00100000:0.0:1787365285.748226:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787365285.748232:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279809bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024500096:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365285.748263:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279809bb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024500096:12345-0@lo:400:kworker.0 Request processed in 31us (1000us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365285.748268:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 99 00000100:00100000:0.0:1787365285.748279:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 100 00000100:00100000:0.0:1787365285.748285:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024499840:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365285.748351:0:3313:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 2 00000004:00080000:1.0:1787365285.748356:0:3313:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f27bb2f0380, transno 4294967324 00000100:00100000:1.0:1787365285.748373:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2788f8ed80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024499456:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365285.748385:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2686973100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024499968:0@lo:400:kworker.0 00000100:00100000:1.0:1787365285.748435:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024499712:0@lo:400:kworker.0 00000100:00100000:1.0:1787365285.748445:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb40ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024499584:0@lo:400:kworker.0 00000100:00100000:1.0:1787365285.748453:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2686970e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024500096:0@lo:400:kworker.0 00000100:00080000:1.0:1787365285.749018:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787365285.749024:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365285.749036:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024499328 00000100:00100000:1.0:1787365285.749041:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024499328 00000100:00100000:1.0:1787365285.749069:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 307 00000100:00100000:1.0:1787365285.749076:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024499328:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365285.755751:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb733800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024499840:12345-0@lo:400:kworker.0 Request processed in 7253us (8120us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365285.755768:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 100 00000100:00100000:1.0:1787365285.755976:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795e050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3312:x1874188024499328:12345-0@lo:400:kworker.0 Request processed in 6898us (8597us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365285.756005:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 307 00000100:00100000:2.0:1787365285.756208:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024499328:0@lo:400:kworker.0 00000100:00100000:2.0:1787365285.756226:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2686972d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024499840:0@lo:400:kworker.0 00010000:00010000:1.0:1787365286.258837:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365287.178788:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365287.178872:0:11946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003546240 00000100:00100000:3.0:1787365287.178881:0:11946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003546240 00000100:00080000:1.0:1787365287.179025:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365287.179083:0:11946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:3.0:1787365287.179095:0:11946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+18:12328:x1874188003546240:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:3.0:1787365287.181084:0:11946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb730000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+19:12328:x1874188003546240:12345-192.168.203.13@tcp:35:umount.0 Request processed in 1982us (2294us total) trans 4294967521 rc 0/0 00000100:00100000:3.0:1787365287.181096:0:11946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 66 00000100:00100000:1.0:1787365287.185553:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365287.187258:0:5837:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003546496 00000100:00100000:2.0:1787365287.187269:0:5837:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003546496 00000100:00100000:2.0:1787365287.187329:0:5837:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:2.0:1787365287.187338:0:5837:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+19:12328:x1874188003546496:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:2.0:1787365287.187697:0:5837:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+20:12328:x1874188003546496:12345-192.168.203.13@tcp:35:umount.0 Request processed in 359us (2151us total) trans 4294967522 rc 0/0 00000100:00100000:2.0:1787365287.187704:0:5837:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 67 00000100:00100000:0.0:1787365287.192308:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365287.192465:0:11946:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003546752 00000100:00100000:3.0:1787365287.192475:0:11946:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003546752 00000100:00100000:3.0:1787365287.192536:0:11946:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:3.0:1787365287.192547:0:11946:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278ac6ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+20:12328:x1874188003546752:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:3.0:1787365287.193202:0:11946:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278ac6ec50 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_002:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:12328:x1874188003546752:12345-192.168.203.13@tcp:35:umount.0 Request processed in 656us (902us total) trans 4294967523 rc 0/0 00000100:00100000:3.0:1787365287.193211:0:11946:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 68 00000100:00100000:3.0:1787365287.202801:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365287.203083:0:5836:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003547008 00000100:00100000:0.0:1787365287.203094:0:5836:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003547008 00000100:00100000:0.0:1787365287.203151:0:5836:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:0.0:1787365287.203161:0:5836:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+21:12328:x1874188003547008:12345-192.168.203.13@tcp:35:umount.0 00000100:00100000:0.0:1787365287.203464:0:5836:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+22:12328:x1874188003547008:12345-192.168.203.13@tcp:35:umount.0 Request processed in 305us (671us total) trans 4294967524 rc 0/0 00000100:00100000:0.0:1787365287.203471:0:5836:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 69 00000100:00100000:1.0:1787365287.208299:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365287.208332:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365287.208363:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365287.208392:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003547136 00000100:00100000:1.0:1787365287.208400:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003547136 00000100:00100000:1.0:1787365287.208445:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003547392 00000100:00100000:1.0:1787365287.208449:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003547392 00000100:00100000:1.0:1787365287.208463:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003547264 00000100:00100000:1.0:1787365287.208466:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003547264 00000100:00100000:1.0:1787365287.208480:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1787365287.208489:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0d7a78e-143d-4100-8e74-6d9e2f230c05+15:2360:x1874188003547136:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365287.208504:0:8434:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365287.208524:0:8434:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2788f44a00/0x872d29295eb46cc5 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 12 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f32 expref: 15 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365287.208538:0:8434:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365287.208597:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f1500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:c0d7a78e-143d-4100-8e74-6d9e2f230c05+14:2360:x1874188003547136:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 108us (306us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365287.208605:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:2.0:1787365287.208833:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:2.0:1787365287.208843:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27882b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+13:2360:x1874188003547392:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787365287.208852:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365287.208862:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2780031400/0x872d29295eb46ef5 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ffd expref: 13 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365287.208899:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365287.208934:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27882b9450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+12:2360:x1874188003547392:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 93us (602us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365287.208941:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:2.0:1787365287.208982:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:2.0:1787365287.209006:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+11:2360:x1874188003547264:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787365287.209013:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365287.209022:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f278f70ae00/0x872d29295eb46c47 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988efa expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365287.209031:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365287.209048:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f0380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2360:x1874188003547264:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 60us (685us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365287.209054:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:2.0:1787365287.214525:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365287.214987:0:10260:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003547776 00000100:00100000:1.0:1787365287.214998:0:10260:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003547776 00000100:00100000:1.0:1787365287.215074:0:10260:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:1.0:1787365287.215084:0:10260:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+7:2358:x1874188003547776:12345-192.168.203.13@tcp:9:umount.0 00000020:00000080:1.0:1787365287.215128:0:10260:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb47221 00000020:00010000:1.0:1787365287.215136:0:10260:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f2789caf000: total 0 00000100:00080000:1.0:1787365287.215141:0:10260:0:(import.c:65:import_set_state_nolock()) ffff9f2789cac800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787365287.215190:0:10260:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000020:00010000:0.0:1787365287.215368:0:5822:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f2789caf000: total 0 00010000:00010000:0.0:1787365287.215406:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f2789caf000, canceled 0 locks, left on hash table 2. 00010000:00010000:0.0:1787365287.215458:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000084806f8e/0x872d29295eb475bd lrc: 0/0,0 mode: --/PR res: [0x280000400:0x4:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891d2 expref: 6 pid: 6682 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365287.215491:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47c5b lrc: 0/0,0 mode: --/PR res: [0x280000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989893a0 expref: 5 pid: 10260 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365287.215523:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f2789caf000, canceled 2 locks, left on hash table 0. 00010000:00010000:0.0:1787365287.215545:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365287.215547:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365287.215548:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787365287.216065:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787365287.216409:0:10260:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb730000 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+2:2358:x1874188003547776:12345-192.168.203.13@tcp:9:umount.0 Request processed in 1324us (1900us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365287.216420:0:10260:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 72 00000100:00100000:2.0:1787365287.234585:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365287.234698:0:6680:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003547904 00000100:00100000:3.0:1787365287.234707:0:6680:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003547904 00000100:00100000:3.0:1787365287.234770:0:6680:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00100000:3.0:1787365287.234780:0:6680:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+5:2358:x1874188003547904:12345-192.168.203.13@tcp:9:umount.0 00000020:00000080:3.0:1787365287.234807:0:6680:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46fb9 00000100:00080000:3.0:1787365287.234816:0:6680:0:(import.c:65:import_set_state_nolock()) ffff9f26847f0000 : changing import state from FULL to CLOSED 00000001:00000004:3.0:1787365287.234856:0:6680:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00010000:00010000:1.0:1787365287.234888:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365287.235102:0:6680:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b66d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+2:2358:x1874188003547904:12345-192.168.203.13@tcp:9:umount.0 Request processed in 323us (525us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365287.235110:0:6680:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 73 00000100:00080000:2.0:1787365287.235172:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787365287.243801:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365287.244551:0:6704:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003548928 00000100:00100000:1.0:1787365287.244560:0:6704:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003548928 00000100:00100000:1.0:1787365287.244671:0:6704:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 240 00000100:00100000:1.0:1787365287.244681:0:6704:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+22:2358:x1874188003548928:12345-192.168.203.13@tcp:39:umount.0 00000020:00000080:1.0:1787365287.244712:0:6704:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46c55 00000020:00010000:1.0:1787365287.244729:0:6704:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f27bbdbd000: total 0 00000100:00080000:1.0:1787365287.244734:0:6704:0:(import.c:65:import_set_state_nolock()) ffff9f27bbdbe000 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787365287.244751:0:6704:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967524 00000020:00010000:0.0:1787365287.244986:0:5822:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f27bbdbd000: total 0 00010000:00010000:0.0:1787365287.244992:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365287.245038:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f27bbdbd000, canceled 0 locks, left on hash table 13. 00010000:00010000:0.0:1787365287.245074:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:0.0:1787365287.245078:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787365287.245087:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27b6e22e00/0x872d29295eb47c46 lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0xd/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989399 expref: 21 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365287.245105:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:0.0:1787365287.245108:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787365287.245112:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708e00/0x872d29295eb4757e lrc: 0/0,0 mode: --/PR res: [0x200000401:0x7:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891bd expref: 20 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365287.245116:0:6704:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b64380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:8662a6a5-8ae3-4336-8479-3ba18dbc45ca+20:2358:x1874188003548928:12345-192.168.203.13@tcp:39:umount.0 Request processed in 434us (1321us total) trans 4294967525 rc 0/0 00000100:00100000:1.0:1787365287.245131:0:6704:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 240 00010000:00010000:0.0:1787365287.245134:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:0.0:1787365287.245138:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint d 00010000:00010000:0.0:1787365287.245143:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030a00/0x872d29295eb475a8 lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0xd/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891cb expref: 18 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365287.245156:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:0.0:1787365287.245158:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787365287.245163:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb708600/0x872d29295eb47c1c lrc: 0/0,0 mode: --/PR res: [0x200000401:0xe:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898938b expref: 17 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365287.245194:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:0.0:1787365287.245197:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787365287.245201:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44c00/0x872d29295eb4791a lrc: 0/0,0 mode: --/CR res: [0x200000401:0xa:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989892c7 expref: 16 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365287.245213:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:0.0:1787365287.245215:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:0.0:1787365287.245218:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044000/0x872d29295eb4727c lrc: 0/0,0 mode: --/CR res: [0x200000401:0x3:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989890f9 expref: 15 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365287.245229:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f27988df600) 00010000:00010000:0.0:1787365287.245232:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787365287.245235:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb46f1f lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898900b expref: 14 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365287.245251:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x7:0x0].0x0 (ffff9f278a0ad100) 00010000:00010000:0.0:1787365287.245253:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787365287.245255:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4749e lrc: 0/0,0 mode: --/CR res: [0x200000401:0x7:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989185 expref: 13 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365287.245268:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0x3:0x0].0x0 (ffff9f278a0ad000) 00010000:00010000:0.0:1787365287.245271:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787365287.245274:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030600/0x872d29295eb46f8f lrc: 0/0,0 mode: --/PR res: [0x200000401:0x3:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989027 expref: 12 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365287.245285:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xe:0x0].0x0 (ffff9f2784761000) 00010000:00010000:0.0:1787365287.245288:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787365287.245296:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709400/0x872d29295eb47b3c lrc: 0/0,0 mode: --/CR res: [0x200000401:0xe:0x0].0x0 bits 0x8/0x0 rrc: 2 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989353 expref: 11 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365287.245311:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000401:0xa:0x0].0x0 (ffff9f2789e48f00) 00010000:00010000:0.0:1787365287.245314:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:0.0:1787365287.245318:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45400/0x872d29295eb4763b lrc: 0/0,0 mode: --/PR res: [0x200000401:0xa:0x0].0x0 bits 0x11/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891f5 expref: 10 pid: 6704 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365287.245333:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f27988dfc00) 00010000:00010000:0.0:1787365287.245335:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787365287.245339:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27bb709600/0x872d29295eb4761f lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989891ee expref: 9 pid: 5835 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365287.245350:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f27988dfd00) 00010000:00010000:0.0:1787365287.245352:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365287.245356:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb46f3b lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989012 expref: 8 pid: 5834 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365287.245368:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f27bbdbd000, canceled 13 locks, left on hash table 0. 00010000:00010000:0.0:1787365287.245380:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365287.245382:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365287.245384:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365287.282842:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365288.306760:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365289.330905:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365289.339613:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365289.339677:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365289.339994:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003549056 00000100:00100000:1.0:1787365289.340004:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003549056 00000100:00100000:1.0:1787365289.340055:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 308 00000100:00100000:1.0:1787365289.340065:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2359:x1874188003549056:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365289.340267:0:5835:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003549184 00000100:00100000:3.0:1787365289.340284:0:5835:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003549184 00000100:00100000:3.0:1787365289.340327:0:5835:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 188 00000100:00100000:3.0:1787365289.340344:0:5835:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279809a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c868fdb9-61c7-472a-bd37-21cfd41249aa+6:2359:x1874188003549184:12345-192.168.203.13@tcp:400:kworker.0 00000100:00080000:0.0:1787365289.340430:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365289.340691:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795ec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2359:x1874188003549056:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 627us (1086us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365289.340708:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 308 00000100:00100000:3.0:1787365289.344543:0:5835:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279809a680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:c868fdb9-61c7-472a-bd37-21cfd41249aa+6:2359:x1874188003549184:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 4196us (4852us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365289.344558:0:5835:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 188 00000100:00100000:2.0:1787365289.843283:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787365289.843307:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb2f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024500224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787365289.843381:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365289.843622:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024500224 00000100:00100000:1.0:1787365289.843646:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024500224 00000100:00100000:1.0:1787365289.843710:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 83 00000100:00100000:1.0:1787365289.843719:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024500224:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787365289.843762:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365289.843818:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6b34700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024500224:12345-0@lo:13:osp-pre-0-0.0 Request processed in 101us (437us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365289.843825:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 83 00000100:00080000:0.0:1787365289.844248:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787365289.844324:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb2f1500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024500224:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787365290.201315:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365290.201416:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365290.208812:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365290.218295:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003549440 00000100:00100000:1.0:1787365290.218308:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003549440 00000100:00100000:1.0:1787365290.218384:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003549312 00000100:00100000:1.0:1787365290.218387:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003549312 00000100:00100000:1.0:1787365290.218411:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:1.0:1787365290.218420:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+11:2362:x1874188003549440:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365290.218437:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365290.218455:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a0f86200/0x872d29295eb46d2e lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f71 expref: 11 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365290.218472:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365290.218535:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+10:2362:x1874188003549440:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 111us (17225us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365290.218542:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:1.0:1787365290.218559:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:1.0:1787365290.218565:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbadb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+9:2362:x1874188003549312:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365290.218572:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365290.218593:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a0f87200/0x872d29295eb46d27 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f47 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365290.218602:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365290.218618:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbadb480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+8:2362:x1874188003549312:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 54us (17203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365290.218649:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:2.0:1787365290.220068:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365290.220140:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003549568 00000100:00100000:3.0:1787365290.220147:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003549568 00000100:00100000:3.0:1787365290.220190:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:3.0:1787365290.220197:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbadad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c0d7a78e-143d-4100-8e74-6d9e2f230c05+8:2362:x1874188003549568:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365290.220210:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365290.220224:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2780031800/0x872d29295eb46eee lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988ff6 expref: 8 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365290.220237:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365290.220268:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbadad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:c0d7a78e-143d-4100-8e74-6d9e2f230c05+7:2362:x1874188003549568:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 72us (11465us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365290.220275:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:1.0:1787365290.220846:0:5834:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003549824 00000100:00100000:1.0:1787365290.220851:0:5834:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003549824 00000100:00100000:1.0:1787365290.220890:0:5834:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 241 00000100:00100000:1.0:1787365290.220898:0:5834:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbadb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c868fdb9-61c7-472a-bd37-21cfd41249aa+6:2358:x1874188003549824:12345-192.168.203.13@tcp:39:umount.0 00000020:00000080:1.0:1787365290.220929:0:5834:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46d3c 00000020:00010000:1.0:1787365290.220938:0:5834:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f27bb321000: total 0 00000100:00080000:1.0:1787365290.220941:0:5834:0:(import.c:65:import_set_state_nolock()) ffff9f27bb326800 : changing import state from FULL to CLOSED 00000001:00000004:1.0:1787365290.220962:0:5834:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967525 00000100:00100000:1.0:1787365290.221132:0:5834:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbadb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:c868fdb9-61c7-472a-bd37-21cfd41249aa+5:2358:x1874188003549824:12345-192.168.203.13@tcp:39:umount.0 Request processed in 234us (1068us total) trans 4294967526 rc 0/0 00000100:00100000:1.0:1787365290.221139:0:5834:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 241 00000020:00010000:1.0:1787365290.221175:0:5822:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f27bb321000: total 0 00010000:00010000:1.0:1787365290.221207:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f27bb321000, canceled 0 locks, left on hash table 1. 00010000:00010000:1.0:1787365290.221233:0:5822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f27988dfc00) 00010000:00010000:1.0:1787365290.221236:0:5822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787365290.221242:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb47c69 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989893a7 expref: 4 pid: 5833 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365290.221260:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f27bb321000, canceled 1 locks, left on hash table 0. 00010000:00010000:1.0:1787365290.221269:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365290.221271:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365290.221283:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365290.255207:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365290.255290:0:5828:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003550080 00000100:00100000:1.0:1787365290.255299:0:5828:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003550080 00000100:00100000:1.0:1787365290.255354:0:5828:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 309 00000100:00100000:1.0:1787365290.255364:0:5828:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+7:2358:x1874188003550080:12345-192.168.203.13@tcp:251:umount.0 00000020:00000080:1.0:1787365290.255404:0:5828:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46c32 00000020:00010000:1.0:1787365290.255411:0:5828:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f27bb324000: total 0 00000100:00080000:1.0:1787365290.255416:0:5828:0:(import.c:65:import_set_state_nolock()) ffff9f27bb327000 : changing import state from FULL to CLOSED 00000100:00100000:1.0:1787365290.255492:0:5828:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795c050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:c0d7a78e-143d-4100-8e74-6d9e2f230c05+3:2358:x1874188003550080:12345-192.168.203.13@tcp:251:umount.0 Request processed in 129us (294us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365290.255500:0:5828:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 309 00000020:00010000:2.0:1787365290.256234:0:5821:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f27bb324000: total 0 00010000:00010000:2.0:1787365290.256239:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365290.256277:0:5821:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f27bb324000, canceled 0 locks, left on hash table 1. 00010000:00010000:2.0:1787365290.256307:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a0f86400/0x872d29295eb46ce8 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98988f39 expref: 2 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365290.256322:0:5821:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f27bb324000, canceled 1 locks, left on hash table 0. 00000020:00000080:2.0:1787365290.256330:0:5821:0:(genops.c:885:class_export_put()) final put ffff9f27bb324000/c0d7a78e-143d-4100-8e74-6d9e2f230c05 00010000:00010000:2.0:1787365290.256350:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365290.256351:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365290.256353:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:3.0:1787365290.256388:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27bb324000/c0d7a78e-143d-4100-8e74-6d9e2f230c05 for MGS 00000020:00000080:3.0:1787365290.256423:0:12661:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f27bb327000 for MGS 00010000:00010000:0.0:1787365290.354897:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787365290.388433:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 8662a6a5-8ae3-4336-8479-3ba18dbc45ca 00000020:00000080:2.0:1787365290.388443:0:6707:0:(genops.c:885:class_export_put()) final put ffff9f26847f1800/8662a6a5-8ae3-4336-8479-3ba18dbc45ca 00000020:00000080:3.0:1787365290.388822:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f26847f1800/8662a6a5-8ae3-4336-8479-3ba18dbc45ca for lustre-OST0000 00000020:00000080:3.0:1787365290.388893:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f26847f0000 for lustre-OST0000 00000100:00100000:1.0:1787365290.866846:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787365290.866869:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024500352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365290.866944:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365290.867124:0:6684:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024500352 00000100:00100000:3.0:1787365290.867131:0:6684:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024500352 00000100:00100000:3.0:1787365290.867193:0:6684:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 84 00000100:00100000:3.0:1787365290.867202:0:6684:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb2f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024500352:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787365290.867235:0:6684:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365290.867292:0:6684:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb2f1500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024500352:12345-0@lo:13:osp-pre-1-0.0 Request processed in 91us (347us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365290.867299:0:6684:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 84 00000100:00100000:1.0:1787365290.867424:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024500480:0@lo:400:kworker.0 00000100:00100000:1.0:1787365290.867454:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365290.867476:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024500992:0@lo:400:kworker.0 00000100:00100000:1.0:1787365290.867502:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365290.867548:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024500352:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365290.867563:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787365290.867568:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb40ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024500864:0@lo:400:kworker.0 00000100:00100000:1.0:1787365290.867590:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365290.867654:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb40b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024500608:0@lo:400:kworker.0 00000100:00100000:1.0:1787365290.867677:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365290.867695:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787365290.867699:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024500736:0@lo:400:kworker.0 00000100:00100000:1.0:1787365290.867730:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365290.867757:0:5827:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024500480 00000100:00100000:1.0:1787365290.867761:0:5827:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024500480 00000100:00100000:1.0:1787365290.867785:0:5827:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1787365290.867792:0:5827:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f278795cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3313:x1874188024500480:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365290.867825:0:5827:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f278795cc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3313:x1874188024500480:12345-0@lo:400:kworker.0 Request processed in 33us (371us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365290.867830:0:5827:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 310 00000100:00100000:1.0:1787365290.867855:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024500992 00000100:00100000:1.0:1787365290.867858:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024500992 00000100:00100000:1.0:1787365290.867894:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024500608 00000100:00100000:1.0:1787365290.867897:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024500608 00000100:00100000:1.0:1787365290.867909:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024500736 00000100:00100000:1.0:1787365290.867911:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024500736 00000100:00100000:1.0:1787365290.867927:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787365290.867933:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2686972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024500992:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365290.867963:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2686972d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3313:x1874188024500992:12345-0@lo:400:kworker.0 Request processed in 31us (461us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365290.867969:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 189 00000100:00100000:1.0:1787365290.867981:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787365290.867986:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2686973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024500608:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365290.868016:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2686973100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024500608:12345-0@lo:400:kworker.0 Request processed in 30us (338us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365290.868022:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 190 00000100:00100000:1.0:1787365290.868033:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787365290.868038:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024500736:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365290.868061:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63b0380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024500736:12345-0@lo:400:kworker.0 Request processed in 23us (330us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365290.868072:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 191 00000100:00100000:1.0:1787365290.868090:0:6682:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024500864 00000100:00100000:1.0:1787365290.868093:0:6682:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024500864 00000100:00100000:1.0:1787365290.868116:0:6682:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787365290.868122:0:6682:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2686970e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024500864:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365290.868151:0:6682:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2686970e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024500864:12345-0@lo:400:kworker.0 Request processed in 30us (559us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365290.868156:0:6682:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 101 00000100:00100000:1.0:1787365290.868187:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb40ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024500864:0@lo:400:kworker.0 00000100:00100000:1.0:1787365290.868195:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:65f8cd6c-cad4-438a-a88d-c44efaabba70:3313:1874188024500480:0@lo:400:kworker.0 00000100:00100000:1.0:1787365290.868202:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024500992:0@lo:400:kworker.0 00000100:00100000:1.0:1787365290.868232:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024500736:0@lo:400:kworker.0 00000100:00100000:1.0:1787365290.868240:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb40b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024500608:0@lo:400:kworker.0 00000100:00080000:0.0:1787365290.868447:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787365290.868452:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:3.0:1787365291.379018:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:1.0:1787365291.442896:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967524 is committed 00000001:00100000:1.0:1787365291.442914:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of c868fdb9-61c7-472a-bd37-21cfd41249aa 00000001:00080000:1.0:1787365291.442919:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967526 is committed 00000020:00000080:1.0:1787365291.442922:0:5855:0:(genops.c:885:class_export_put()) final put ffff9f27bb321000/c868fdb9-61c7-472a-bd37-21cfd41249aa 00000001:00100000:1.0:1787365291.442934:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 8662a6a5-8ae3-4336-8479-3ba18dbc45ca 00000001:00080000:1.0:1787365291.442938:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 4294967525 is committed 00000020:00000080:1.0:1787365291.442948:0:5855:0:(genops.c:885:class_export_put()) final put ffff9f27bbdbd000/8662a6a5-8ae3-4336-8479-3ba18dbc45ca 00000020:00000080:0.0:1787365291.443375:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27bb321000/c868fdb9-61c7-472a-bd37-21cfd41249aa for lustre-MDT0000 00000020:00000080:0.0:1787365291.444086:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27bbdbd000/8662a6a5-8ae3-4336-8479-3ba18dbc45ca for lustre-MDT0000 00000020:00000080:0.0:1787365291.444139:0:12661:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f27bb326800 for lustre-MDT0000 00000020:00000080:0.0:1787365291.444144:0:12661:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f27bbdbe000 for lustre-MDT0000 00000001:00100000:1.0:1787365291.449099:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 8662a6a5-8ae3-4336-8479-3ba18dbc45ca 00000020:00000080:1.0:1787365291.449109:0:7624:0:(genops.c:885:class_export_put()) final put ffff9f2789caf000/8662a6a5-8ae3-4336-8479-3ba18dbc45ca 00000020:00000080:1.0:1787365291.449136:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2789caf000/8662a6a5-8ae3-4336-8479-3ba18dbc45ca for lustre-OST0001 00000020:00000080:1.0:1787365291.449180:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f2789cac800 for lustre-OST0001 00000040:00080000:2.0:1787365291.634993:0:11664:0:(llog.c:805:llog_process_thread()) index: 1, lh_last_idx: 1 synced_idx: 1 lgh_last_idx: 1 00000040:00080000:2.0:1787365291.635005:0:11664:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0x8:0x0] at index 1 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787365291.642754:0:11664:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x8:0x0] index 6 count 1 00000040:00080000:3.0:1787365291.642779:0:11664:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 2 count 2 00010000:00010000:0.0:1787365292.403603:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:3.0:1787365292.611510:0:13010:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:3.0:1787365292.654068:0:13010:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-MDT0000 00010000:00010000:3.0:1787365292.654119:0:13010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb46cb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46cbe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365292.654133:0:13010:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb46cb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46cbe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365292.654140:0:13010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb46cb7 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x872d29295eb46cbe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365292.654147:0:13010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb46cb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000400000000 nid: local remote: 0x872d29295eb46cbe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365292.654173:0:13010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:3.0:1787365292.654178:0:13010:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:3.0:1787365292.654202:0:13010:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787365292.654206:0:13010:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 3 00000100:00080000:3.0:1787365292.654212:0:13010:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00080000:3.0:1787365292.654238:0:13010:0:(import.c:65:import_set_state_nolock()) ffff9f27b64d5800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:0.0:1787365292.654294:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874188024501120:0@lo:39:umount.0 00000100:00100000:0.0:1787365292.654361:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365292.654467:0:5833:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024501120 00000100:00100000:1.0:1787365292.654475:0:5833:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024501120 00000100:00100000:1.0:1787365292.654522:0:5833:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 242 00000100:00100000:1.0:1787365292.654530:0:5833:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874188024501120:12345-0@lo:39:umount.0 00000020:00000080:1.0:1787365292.654552:0:5833:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46a41 00000100:00080000:1.0:1787365292.654560:0:5833:0:(import.c:65:import_set_state_nolock()) ffff9f27b6283800 : changing import state from FULL to CLOSED 00010000:00010000:2.0:1787365292.654651:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787365292.654658:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb46cb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x872d29295eb46cbe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365292.654666:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cd600 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:2.0:1787365292.654669:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb46cb7 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000400000000 nid: local remote: 0x872d29295eb46cbe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365292.654677:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb46cb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1008400000000 nid: local remote: 0x872d29295eb46cbe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787365292.654684:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb46cb7 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1009400000000 nid: local remote: 0x872d29295eb46cbe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365292.654703:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:2.0:1787365292.654706:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:2.0:1787365292.654708:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:2.0:1787365292.654734:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb46cb7 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x872d29295eb46cbe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365292.654740:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787365292.654757:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb46cb7 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x872d29295eb46cbe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365292.654763:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb46cb7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x5809400000020 nid: local remote: 0x872d29295eb46cbe expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365292.654774:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365292.654776:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365292.654777:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365292.674384:0:5833:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798098700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+1:3309:x1874188024501120:12345-0@lo:39:umount.0 Request processed in 19845us (20013us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365292.674398:0:5833:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 242 00000020:00000080:1.0:1787365292.674416:0:5833:0:(genops.c:885:class_export_put()) final put ffff9f27b6280800/lustre-MDT0000-lwp-MDT0000_UUID 00010000:00010000:1.0:1787365292.674498:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365292.674515:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbad9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024501248:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787365292.674575:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365292.674639:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024501248 00000100:00100000:1.0:1787365292.674645:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024501248 00000100:00100000:1.0:1787365292.674702:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787365292.674711:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+19:3310:x1874188024501248:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787365292.674724:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365292.674742:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2788f44e00/0x872d29295eb46cbe lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x872d29295eb46cb7 expref: 19 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.674757:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365292.674799:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63b0700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:3310:x1874188024501248:12345-0@lo:103:ldlm_bl.0 Request processed in 89us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365292.674806:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:1.0:1787365292.674841:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbad9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:65f8cd6c-cad4-438a-a88d-c44efaabba70:3310:1874188024501248:0@lo:103:ldlm_bl.0 00000100:00080000:0.0:1787365292.674965:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9f27b64d5800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:0.0:1787365292.674986:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf92a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874188024501120:0@lo:39:umount.0 00000100:00080000:1.0:1787365292.675358:0:13010:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787365292.675376:0:13010:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 4 00000100:00100000:1.0:1787365292.675381:0:13010:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787365292.677554:0:13010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46ccc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46cd3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.677571:0:13010:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46ccc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46cd3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.677578:0:13010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46ccc lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x872d29295eb46cd3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.677586:0:13010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46ccc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000400000000 nid: local remote: 0x872d29295eb46cd3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.677612:0:13010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787365292.677619:0:13010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46bec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46bf3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.677642:0:13010:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46bec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46bf3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.677649:0:13010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46bec lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x872d29295eb46bf3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.677655:0:13010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x872d29295eb46bf3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.677667:0:13010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787365292.677683:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787365292.677690:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46ccc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x872d29295eb46cd3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.677708:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a0f86a00 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:1.0:1787365292.677712:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46ccc lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000400000000 nid: local remote: 0x872d29295eb46cd3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.677720:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46ccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1008400000000 nid: local remote: 0x872d29295eb46cd3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787365292.677728:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46ccc lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1009400000000 nid: local remote: 0x872d29295eb46cd3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365292.677734:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787365292.677737:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-MDT0000: stopping, won't requeue 00010000:00010000:1.0:1787365292.677766:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46ccc lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x872d29295eb46cd3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.677773:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787365292.679122:0:13010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780030c00/0x872d29295eb46ee0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ee7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365292.679136:0:13010:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780030c00/0x872d29295eb46ee0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46ee7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365292.679143:0:13010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780030c00/0x872d29295eb46ee0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x872d29295eb46ee7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365292.679149:0:13010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9f2780030c00/0x872d29295eb46ee0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x872d29295eb46ee7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365292.679161:0:13010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787365292.679167:0:13010:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87600/0x872d29295eb469a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb469a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365292.679172:0:13010:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87600/0x872d29295eb469a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb469a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365292.679178:0:13010:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87600/0x872d29295eb469a0 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x872d29295eb469a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365292.679194:0:13010:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87600/0x872d29295eb469a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x872d29295eb469a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365292.679202:0:13010:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to regular blp list, 3 blwis in pool 10000000:01000000:0.0:1787365292.679206:0:13010:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-MDT0000 10000000:01000000:0.0:1787365292.679213:0:13010:0:(mgc_request.c:547:config_log_end()) end config log lustre-MDT0000 (0) 00000020:01000004:0.0:1787365292.679243:0:13010:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-MDT0000 00000020:01000000:0.0:1787365292.679247:0:13010:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000 (flags='F') 00000020:00000080:0.0:1787365292.679251:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787365292.679256:0:13010:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000: forcing exports to disconnect: 2/7 00000020:00080000:0.0:1787365292.679262:0:13010:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9f2685885000 lustre-MDT0000-lwp-OST0001_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787365292.679267:0:13010:0:(genops.c:1819:print_export_data()) lustre-MDT0000: ACTIVE ffff9f27bf098800 lustre-MDT0000-lwp-OST0000_UUID 0@lo 4 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787365292.679271:0:13010:0:(genops.c:1553:class_disconnect_exports()) OBD device 5 (ffff9f278456b370) has exports, disconnecting them 00000020:00080000:0.0:1787365292.679275:0:13010:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f2685885000), last request at 1787365290 00000020:00000080:0.0:1787365292.679282:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46bb4 00000100:00080000:0.0:1787365292.679299:0:13010:0:(import.c:65:import_set_state_nolock()) ffff9f2685887000 : changing import state from FULL to CLOSED 00000020:00080000:0.0:1787365292.679340:0:13010:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f2685885000): rc 0 00000020:00000080:0.0:1787365292.679343:0:13010:0:(genops.c:885:class_export_put()) final put ffff9f2685885000/lustre-MDT0000-lwp-OST0001_UUID 00010000:00010000:2.0:1787365292.679411:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:1.0:1787365292.683656:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46ccc lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x872d29295eb46cd3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.683674:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a0f86a00/0x872d29295eb46ccc lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x5809400000020 nid: local remote: 0x872d29295eb46cd3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.683698:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787365292.683703:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f2780030c00/0x872d29295eb46ee0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x872d29295eb46ee7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.683711:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030c00 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:1.0:1787365292.683715:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f2780030c00/0x872d29295eb46ee0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x872d29295eb46ee7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.683746:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f2780030c00/0x872d29295eb46ee0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x872d29295eb46ee7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787365292.683754:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f2780030c00/0x872d29295eb46ee0 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x872d29295eb46ee7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365292.683760:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787365292.683762:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787365292.683766:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787365292.683816:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f2780030c00/0x872d29295eb46ee0 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x872d29295eb46ee7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.683823:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787365292.683845:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f2780030c00/0x872d29295eb46ee0 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x872d29295eb46ee7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.683852:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f2780030c00/0x872d29295eb46ee0 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000020 nid: local remote: 0x872d29295eb46ee7 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.683863:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00000100:00100000:2.0:1787365292.684303:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024501376:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787365292.684369:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365292.684526:0:8435:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024501376 00000100:00100000:2.0:1787365292.684534:0:8435:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024501376 00000100:00100000:2.0:1787365292.684579:0:8435:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787365292.684588:0:8435:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:3311:x1874188024501376:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787365292.684600:0:8435:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365292.684615:0:8435:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a0f87400/0x872d29295eb46cd3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x872d29295eb46ccc expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365292.684644:0:8435:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365292.684701:0:8435:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad9c00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_004:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:3311:x1874188024501376:12345-0@lo:103:ldlm_bl.0 Request processed in 114us (331us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365292.684709:0:8435:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787365292.684749:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63b1c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024501376:0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787365292.685103:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87600/0x872d29295eb469a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x872d29295eb469a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.685111:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a0f87600 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:1.0:1787365292.685114:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87600/0x872d29295eb469a0 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x872d29295eb469a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.685122:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87600/0x872d29295eb469a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x872d29295eb469a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787365292.685140:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87600/0x872d29295eb469a0 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x872d29295eb469a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365292.685146:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x5:0x0].0x0 (lustre) 10000000:01000000:1.0:1787365292.685148:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-barrier: stopping, won't requeue 10000000:01000000:1.0:1787365292.685151:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-barrier 00010000:00010000:1.0:1787365292.685172:0:5822:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87600/0x872d29295eb469a0 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x872d29295eb469a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.685178:0:5822:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787365292.685187:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87600/0x872d29295eb469a0 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x872d29295eb469a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.685193:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a0f87600/0x872d29295eb469a0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x872d29295eb469a7 expref: -99 pid: 5814 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.685209:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365292.685210:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365292.685212:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365292.685228:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024501504:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787365292.685262:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365292.685295:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787365292.685301:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb40b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024501632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787365292.685324:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365292.685354:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024501504 00000100:00100000:1.0:1787365292.685358:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024501504 00000100:00100000:1.0:1787365292.685383:0:5820:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024501632 00000100:00100000:1.0:1787365292.685386:0:5820:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024501632 00000100:00100000:1.0:1787365292.685403:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787365292.685417:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27882ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+18:3312:x1874188024501504:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787365292.685427:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365292.685437:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2780030400/0x872d29295eb46ee7 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x872d29295eb46ee0 expref: 18 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.685447:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365292.685476:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27882ba850 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+17:3312:x1874188024501504:12345-0@lo:103:ldlm_bl.0 Request processed in 60us (213us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365292.685482:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:1.0:1787365292.685519:0:5820:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787365292.685524:0:5820:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb409880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+16:3312:x1874188024501632:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787365292.685531:0:5820:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365292.685540:0:5820:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f278f70ac00/0x872d29295eb469a7 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x872d29295eb469a0 expref: 16 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365292.685551:0:5820:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365292.685573:0:5820:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb409880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:3312:x1874188024501632:12345-0@lo:103:ldlm_bl.0 Request processed in 48us (248us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365292.685578:0:5820:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:1.0:1787365292.685604:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb40b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024501632:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787365292.685611:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbfbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:65f8cd6c-cad4-438a-a88d-c44efaabba70:3312:1874188024501504:0@lo:103:ldlm_bl.0 00000020:00000080:3.0:1787365292.685720:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27b6280800/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787365292.686799:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f27b6283800 for lustre-MDT0000 00010000:00010000:1.0:1787365292.687061:0:13011:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365292.687065:0:13011:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365292.687067:0:13011:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365292.687103:0:5821:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x872d29295eb46bf3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365292.687113:0:5821:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780031e00 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:2.0:1787365292.687117:0:5821:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46bec lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x872d29295eb46bf3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365292.687126:0:5821:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x872d29295eb46bf3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787365292.687133:0:5821:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46bec lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x872d29295eb46bf3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365292.687139:0:5821:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 10000000:01000000:2.0:1787365292.687141:0:5821:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-mdtir: stopping, won't requeue 10000000:01000000:2.0:1787365292.687144:0:5821:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-mdtir 00010000:00010000:2.0:1787365292.687173:0:5821:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46bec lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x872d29295eb46bf3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365292.687180:0:5821:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787365292.687210:0:5821:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46bec lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x872d29295eb46bf3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365292.687218:0:5821:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f2780031e00/0x872d29295eb46bec lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000020 nid: local remote: 0x872d29295eb46bf3 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365292.687247:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365292.687249:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365292.687250:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365292.687294:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787365292.687308:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024501760:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787365292.687351:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365292.687456:0:5819:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024501760 00000100:00100000:2.0:1787365292.687462:0:5819:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024501760 00000100:00100000:2.0:1787365292.687507:0:5819:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787365292.687516:0:5819:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+15:3311:x1874188024501760:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787365292.687526:0:5819:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365292.687537:0:5819:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a0f86600/0x872d29295eb46bf3 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x872d29295eb46bec expref: 15 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365292.687551:0:5819:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365292.687648:0:5819:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf92a00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:65f8cd6c-cad4-438a-a88d-c44efaabba70+14:3311:x1874188024501760:12345-0@lo:103:ldlm_bl.0 Request processed in 111us (273us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365292.687656:0:5819:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000020:00080000:0.0:1787365292.687806:0:13010:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000: disconnecting export at 0@lo (ffff9f27bf098800), last request at 1787365290 00000020:00000080:0.0:1787365292.687814:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46ae9 00000100:00080000:0.0:1787365292.687824:0:13010:0:(import.c:65:import_set_state_nolock()) ffff9f27bf09c000 : changing import state from FULL to CLOSED 00010000:00010000:1.0:1787365292.687951:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00080000:2.0:1787365292.688021:0:13010:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f27bf098800): rc 0 00000020:00000080:2.0:1787365292.688024:0:13010:0:(genops.c:885:class_export_put()) final put ffff9f27bf098800/lustre-MDT0000-lwp-OST0000_UUID 00000004:00000080:2.0:1787365292.688035:0:13010:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=400866e7 len=0 karg=ffffaab440d7fae0 00000100:00080000:2.0:1787365292.688055:0:13010:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787365292.688059:0:13010:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 3 00000004:00080000:2.0:1787365292.688078:0:13010:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787365292.688144:0:13010:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000100:00080000:2.0:1787365292.688157:0:13010:0:(import.c:65:import_set_state_nolock()) ffff9f278835d800 lustre-OST0000_UUID: changing import state from FULL to CONNECTING 00000100:00080000:2.0:1787365292.688175:0:13010:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787365292.688178:0:13010:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 3 00000004:00080000:2.0:1787365292.688185:0:13010:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00080000:2.0:1787365292.688243:0:13010:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000100:00080000:2.0:1787365292.688251:0:13010:0:(import.c:65:import_set_state_nolock()) ffff9f27bbdba000 lustre-OST0001_UUID: changing import state from FULL to CONNECTING 00000020:00080000:2.0:1787365292.688286:0:13010:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9f278456b370) has no exports 00000020:00000080:2.0:1787365292.688303:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2685885000/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000 00000020:00000080:2.0:1787365292.688338:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27bf098800/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000 00000020:00000080:2.0:1787365292.688360:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f2685887000 for lustre-MDT0000 00000020:00000080:2.0:1787365292.688365:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f27bf09c000 for lustre-MDT0000 00000100:00100000:0.0:1787365292.698261:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024501888:0@lo:9:umount.0 00000100:00100000:0.0:1787365292.698337:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365292.698391:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024502016:0@lo:9:umount.0 00000100:00100000:0.0:1787365292.698415:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365292.698500:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024501888 00000100:00100000:2.0:1787365292.698508:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024501888 00000100:00100000:2.0:1787365292.698582:0:6681:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024502016 00000100:00100000:2.0:1787365292.698586:0:6681:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024502016 00000100:00100000:2.0:1787365292.698609:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787365292.698617:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874188024501888:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787365292.698672:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46b36 00000100:00080000:2.0:1787365292.698683:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9f27bf09a000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787365292.698715:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 1, last_transno is 4294967310 00000100:00100000:2.0:1787365292.699048:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798098a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3309:x1874188024501888:12345-0@lo:9:umount.0 Request processed in 430us (709us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365292.699057:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00100000:2.0:1787365292.699073:0:6681:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787365292.699079:0:6681:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3309:x1874188024502016:12345-0@lo:9:umount.0 00000020:00000080:2.0:1787365292.699091:0:6681:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46c2b 00000100:00080000:2.0:1787365292.699096:0:6681:0:(import.c:65:import_set_state_nolock()) ffff9f2685882800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787365292.699116:0:6681:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 1, last_transno is 4294967324 00000100:00100000:2.0:1787365292.699302:0:6681:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798098380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+2:3309:x1874188024502016:12345-0@lo:9:umount.0 Request processed in 223us (886us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365292.699308:0:6681:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00010000:00010000:2.0:1787365292.699327:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787365292.699809:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787365292.699828:0:5830:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:0.0:1787365292.699860:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9f278835d800 lustre-OST0000_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787365292.699887:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787365292.699889:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787365292.699893:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024501888:0@lo:9:umount.0 00000100:00080000:0.0:1787365292.699906:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9f27bbdba000 lustre-OST0001_UUID: changing import state from CONNECTING to CLOSED 00000004:00080000:0.0:1787365292.699910:0:3309:0:(osp_dev.c:1618:osp_import_event()) got disconnected 00000004:00080000:0.0:1787365292.699911:0:3309:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:0.0:1787365292.699913:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024502016:0@lo:9:umount.0 00010000:00010000:0.0:1787365292.699964:0:13011:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365292.700359:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbad9180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024501760:0@lo:103:ldlm_bl.0 00000020:00080000:3.0:1787365292.720032:0:13010:0:(genops.c:1558:class_disconnect_exports()) OBD device 5 (ffff9f278456b370) has no exports 00000020:00000080:3.0:1787365292.755443:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb469fb 00000020:00000080:3.0:1787365292.755461:0:13010:0:(genops.c:885:class_export_put()) final put ffff9f27b626a000/lustre-QMT0000_UUID 00000020:01000000:3.0:1787365292.755487:0:13010:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-QMT0000 (flags='') 00000020:00000080:1.0:1787365292.755602:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27b626a000/lustre-QMT0000_UUID for lustre-QMT0000 00000020:00000080:0.0:1787365292.755777:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787365292.755787:0:13010:0:(obd_config.c:956:class_cleanup()) lustre-QMT0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787365292.755793:0:13010:0:(genops.c:1558:class_disconnect_exports()) OBD device 7 (ffff9f27845699b8) has no exports 00000020:00000080:0.0:1787365292.756767:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb469f4 00000020:00000080:0.0:1787365292.756775:0:13010:0:(genops.c:885:class_export_put()) final put ffff9f278fe67000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787365292.756839:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787365292.756848:0:13010:0:(obd_config.c:883:class_detach()) detach on obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787365292.756851:0:13010:0:(genops.c:885:class_export_put()) final put ffff9f27bbecc800/lustre-QMT0000_UUID 00000020:00000080:0.0:1787365292.756854:0:13010:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27bbecc800/lustre-QMT0000_UUID for lustre-QMT0000 00000020:01000000:0.0:1787365292.756883:0:13010:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-QMT0000 (lustre-QMT0000_UUID) 00000020:00000080:1.0:1787365292.759093:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f278fe67000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787365292.762436:0:13010:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f2789006f60 - data ffff9f27bff37438/ffff9f27bb73e000 00000020:01000000:0.0:1787365292.762593:0:13010:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f2784d9cd20 - data ffff9f27b2fce6c0/ffff9f27b6af3400 00000001:00000004:0.0:1787365292.801705:0:13010:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 1, last_transno is 4294967526 00000100:00080000:2.0:1787365292.919267:0:13010:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787365292.919275:0:13010:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 4 00000004:00080000:2.0:1787365292.919357:0:13010:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787365292.919361:0:13010:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:1.0:1787365292.921069:0:6866:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:1.0:1787365292.921084:0:6866:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x3:0x0] index 5 count 1 00000040:00080000:1.0:1787365292.921096:0:6866:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x2:0x0] index 1 count 2 00000100:00080000:1.0:1787365292.930066:0:13010:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:1.0:1787365292.930074:0:13010:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 4 00000004:00080000:1.0:1787365292.930095:0:13010:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:1.0:1787365292.930098:0:13010:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000004:00080000:0.0:1787365292.930427:0:8088:0:(osp_sync.c:1324:osp_sync_process_queues()) stop llog processing 00000040:00080000:0.0:1787365292.930432:0:8088:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0x6:0x0] index 8 count 1 00000040:00080000:0.0:1787365292.930442:0:8088:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x1:0x5:0x0] index 1 count 2 00000020:00000080:2.0:1787365293.017537:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb469c3 00000020:00000080:2.0:1787365293.017549:0:13010:0:(genops.c:885:class_export_put()) final put ffff9f2794eb0800/lustre-MDT0000-osd_UUID 00000020:00000080:2.0:1787365293.019401:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb469d8 00000020:00000080:2.0:1787365293.019411:0:13010:0:(genops.c:885:class_export_put()) final put ffff9f27bbec9000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787365293.019418:0:13010:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-mdtlov (flags='') 00000020:00000080:2.0:1787365293.019423:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787365293.019431:0:13010:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-mdtlov: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787365293.019435:0:13010:0:(genops.c:1558:class_disconnect_exports()) OBD device 4 (ffff9f2784568000) has no exports 00000020:00000080:1.0:1787365293.020228:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2794eb0800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787365293.020243:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27bbec9000/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000004:01000000:2.0:1787365293.020549:0:13010:0:(lod_lov.c:59:lod_putref()) destroying 2 ltd desc 00000020:00000080:2.0:1787365293.020559:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46c16 00000020:00000080:2.0:1787365293.020566:0:13010:0:(genops.c:885:class_export_put()) final put ffff9f27bbdbf000/lustre-MDT0000-mdtlov_UUID 00000020:01000000:2.0:1787365293.020572:0:13010:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787365293.020576:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787365293.020593:0:13010:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787365293.020597:0:13010:0:(genops.c:1558:class_disconnect_exports()) OBD device 17 (ffff9f27bafb19b8) has no exports 00000020:00000080:2.0:1787365293.020605:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46c0f 00000020:00000080:2.0:1787365293.020608:0:13010:0:(genops.c:885:class_export_put()) final put ffff9f27892d3000/lustre-MDT0000-osd_UUID 00000020:00000080:1.0:1787365293.021290:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27bbdbf000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787365293.021300:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27892d3000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00010000:01000000:2.0:1787365293.021420:0:13010:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0001-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787365293.021424:0:13010:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0001_UUID INVALID 00000100:00100000:2.0:1787365293.021428:0:13010:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 4294967324 gen 5 00000004:00080000:2.0:1787365293.021433:0:13010:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787365293.021435:0:13010:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787365293.021522:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787365293.021530:0:13010:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787365293.021537:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46b2f 00000020:00000080:2.0:1787365293.021542:0:13010:0:(genops.c:885:class_export_put()) final put ffff9f27882fd800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787365293.027765:0:12661:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f27bbdba000 for lustre-OST0001-osc-MDT0000 00000020:00000080:1.0:1787365293.027780:0:12661:0:(genops.c:885:class_export_put()) final put ffff9f27b6d8a000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787365293.027783:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27b6d8a000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001-osc-MDT0000 00000020:01000000:1.0:1787365293.027977:0:12661:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:01000000:2.0:1787365293.030733:0:13010:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osc-MDT0000 (flags='') 00000020:00000080:2.0:1787365293.030747:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787365293.030760:0:13010:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osc-MDT0000: forcing exports to disconnect: 0/3 00000020:00080000:2.0:1787365293.030764:0:13010:0:(genops.c:1558:class_disconnect_exports()) OBD device 13 (ffff9f27bafb4d28) has no exports 00000020:00000080:2.0:1787365293.030785:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46b28 00000020:00000080:2.0:1787365293.030805:0:13010:0:(genops.c:885:class_export_put()) final put ffff9f278835f800/lustre-MDT0000-osd_UUID 00010000:01000000:2.0:1787365293.031201:0:13010:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-OST0000-osc-MDT0000: client import never connected 00000100:00080000:2.0:1787365293.031205:0:13010:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-OST0000_UUID INVALID 00000100:00100000:2.0:1787365293.031209:0:13010:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 4294967310 gen 5 00000004:00080000:2.0:1787365293.031215:0:13010:0:(osp_dev.c:1634:osp_import_event()) got inactive 00000100:00100000:2.0:1787365293.031217:0:13010:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:2.0:1787365293.031253:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787365293.031260:0:13010:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787365293.031290:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787365293.031293:0:13010:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787365293.031296:0:13010:0:(genops.c:885:class_export_put()) final put ffff9f2794eb2800/lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787365293.031299:0:13010:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2794eb2800/lustre-MDT0000-mdtlov_UUID for lustre-MDT0000-mdtlov 00000020:01000000:2.0:1787365293.031305:0:13010:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-mdtlov (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:2.0:1787365293.031445:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb469df 00000020:00000080:2.0:1787365293.031450:0:13010:0:(genops.c:885:class_export_put()) final put ffff9f27bbec8000/lustre-MDD0000_UUID 00000020:01000000:2.0:1787365293.031454:0:13010:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDD0000 (flags='') 00000020:00000080:2.0:1787365293.031457:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787365293.031460:0:13010:0:(obd_config.c:956:class_cleanup()) lustre-MDD0000: forcing exports to disconnect: 0/2 00000020:00080000:2.0:1787365293.031463:0:13010:0:(genops.c:1558:class_disconnect_exports()) OBD device 6 (ffff9f278456cd28) has no exports 00000020:00000080:2.0:1787365293.031483:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787365293.031486:0:13010:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000020:00000080:2.0:1787365293.031490:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb469e6 00000020:00000080:2.0:1787365293.031493:0:13010:0:(genops.c:885:class_export_put()) final put ffff9f27bbeca000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787365293.031500:0:13010:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f2797a7c800 from lustre-MDT0000, refs=3 00000020:01000004:2.0:1787365293.031503:0:13010:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f2797a7c800 3 00000020:01000004:2.0:1787365293.031506:0:13010:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f2797a7c800 from lustre-MDT0000 00000020:00000080:2.0:1787365293.031521:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787365293.031524:0:13010:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:00000080:2.0:1787365293.031526:0:13010:0:(genops.c:885:class_export_put()) final put ffff9f2794eb7000/lustre-MDT0000_UUID 00000020:00000080:2.0:1787365293.031529:0:13010:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2794eb7000/lustre-MDT0000_UUID for lustre-MDT0000 00000020:01000000:2.0:1787365293.031534:0:13010:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000 (lustre-MDT0000_UUID) 00000020:01000004:2.0:1787365293.031569:0:13010:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 2 references. 00000020:01000004:2.0:1787365293.031573:0:13010:0:(tgt_mount.c:255:server_stop_mgs()) Stop MGS service MGS 00000020:01000000:2.0:1787365293.031576:0:13010:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGS (flags='F') 00000020:00000080:2.0:1787365293.031579:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787365293.031581:0:13010:0:(obd_config.c:956:class_cleanup()) MGS: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787365293.031588:0:13010:0:(genops.c:1819:print_export_data()) MGS: ACTIVE ffff9f27892b1800 65f8cd6c-cad4-438a-a88d-c44efaabba70 0@lo 13 (0 0 8) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787365293.031593:0:13010:0:(genops.c:1553:class_disconnect_exports()) OBD device 1 (ffff9f2786aa4d28) has exports, disconnecting them 00000020:00080000:2.0:1787365293.031597:0:13010:0:(genops.c:1528:class_disconnect_export_list()) MGS: disconnecting export at 0@lo (ffff9f27892b1800), last request at 1787365048 00000020:00000080:2.0:1787365293.031611:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46984 00000020:00010000:2.0:1787365293.031615:0:13010:0:(genops.c:1921:obd_stale_export_put()) Put export ffff9f27892b1800: total 4 00000100:00080000:2.0:1787365293.031618:0:13010:0:(import.c:65:import_set_state_nolock()) ffff9f27892b3000 : changing import state from FULL to CLOSED 00000020:00080000:2.0:1787365293.031657:0:13010:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f27892b1800): rc 0 00000020:00080000:2.0:1787365293.031661:0:13010:0:(genops.c:1558:class_disconnect_exports()) OBD device 1 (ffff9f2786aa4d28) has no exports 00000100:00100000:2.0:1787365293.031719:0:5827:0:(service.c:3183:ptlrpc_main()) ll_mgs_0000: service thread [ffff9f2789352c00:5827] 0 exiting: rc = 1 00000100:00100000:2.0:1787365293.031801:0:5828:0:(service.c:3183:ptlrpc_main()) ll_mgs_0001: service thread [ffff9f27845c2e00:5828] 1 exiting: rc = 0 00000020:00000080:1.0:1787365293.032089:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27882fd800/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787365293.032098:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f278835f800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:1.0:1787365293.032104:0:12661:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f278835d800 for lustre-OST0000-osc-MDT0000 00000020:00000080:1.0:1787365293.032108:0:12661:0:(genops.c:885:class_export_put()) final put ffff9f278835c000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787365293.032110:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f278835c000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000-osc-MDT0000 00000020:01000000:1.0:1787365293.032113:0:12661:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osc-MDT0000 (lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787365293.032200:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27bbec8000/lustre-MDD0000_UUID for lustre-MDD0000 00000020:00000080:1.0:1787365293.032204:0:12661:0:(genops.c:885:class_export_put()) final put ffff9f2794eb4800/lustre-MDD0000_UUID 00000020:00000080:1.0:1787365293.032205:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2794eb4800/lustre-MDD0000_UUID for lustre-MDD0000 00000020:01000000:1.0:1787365293.032208:0:12661:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDD0000 (lustre-MDD0000_UUID) 00000020:00000080:1.0:1787365293.032371:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27bbeca000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00010000:0.0:1787365293.032514:0:5822:0:(genops.c:1907:obd_stale_export_get()) Get export ffff9f27892b1800: total 0 00010000:00010000:0.0:1787365293.032540:0:5822:0:(ldlm_lock.c:2651:ldlm_export_cancel_blocked_locks()) Export ffff9f27892b1800, canceled 0 locks, left on hash table 8. 00010000:00010000:0.0:1787365293.032568:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2798115000/0x872d29295eb46ecb lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x872d29295eb46ec4 expref: 9 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365293.032610:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2798115400/0x872d29295eb46ed9 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x872d29295eb46ed2 expref: 8 pid: 5828 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365293.032656:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a12cda00/0x872d29295eb46a9c lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x872d29295eb46a95 expref: 7 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365293.032681:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a0f87e00/0x872d29295eb46c86 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x872d29295eb46c7f expref: 6 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365293.032693:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2788f44600/0x872d29295eb46c94 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x872d29295eb46c8d expref: 5 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365293.032703:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a0f86800/0x872d29295eb46cb0 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x872d29295eb46ca9 expref: 4 pid: 5827 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365293.032712:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a0f87c00/0x872d29295eb46ca2 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x872d29295eb46c9b expref: 3 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365293.032721:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a0f86000/0x872d29295eb46ce1 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x44801000000000 nid: 0@lo remote: 0x872d29295eb46cda expref: 2 pid: 5829 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365293.032731:0:5822:0:(ldlm_lock.c:2679:ldlm_export_cancel_locks()) Export ffff9f27892b1800, canceled 8 locks, left on hash table 0. 00000020:00000080:0.0:1787365293.032744:0:5822:0:(genops.c:885:class_export_put()) final put ffff9f27892b1800/65f8cd6c-cad4-438a-a88d-c44efaabba70 00010000:00010000:0.0:1787365293.032758:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365293.032761:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365293.032763:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365293.032919:0:5829:0:(service.c:3183:ptlrpc_main()) ll_mgs_0002: service thread [ffff9f2788c4c200:5829] 2 exiting: rc = 0 00000020:00000080:1.0:1787365293.033053:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27892b1800/65f8cd6c-cad4-438a-a88d-c44efaabba70 for MGS 00000020:00000080:1.0:1787365293.033089:0:12661:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f27892b3000 for MGS 00000100:00100000:2.0:1787365293.033620:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.033645:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.033650:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.033655:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.033661:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.033679:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.033685:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.033690:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.033696:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.033702:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.033708:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.033713:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.033718:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.033725:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.033730:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.033736:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.033742:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.033747:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.033764:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.033769:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.033774:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.033780:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.033786:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.033791:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034100:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034107:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034117:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034122:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034128:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034134:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034139:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034144:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034150:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034156:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034161:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034179:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034185:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034191:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034196:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034201:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034206:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034212:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034217:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034223:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034228:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034234:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034239:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034244:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034250:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034255:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034261:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034266:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034271:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034286:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034292:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034297:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034303:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034307:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034313:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034318:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034324:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034330:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034336:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.034341:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 20000000:01000000:2.0:1787365293.035022:0:13010:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:2.0:1787365293.035026:0:13010:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 00000020:01000000:2.0:1787365293.043937:0:13010:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f2788e3f360 - data ffff9f27b0c320d8/ffff9f2684732800 00000020:01000000:2.0:1787365293.044074:0:13010:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f27893ca900 - data ffff9f27b2d46a20/ffff9f27883e6000 00000020:00000080:2.0:1787365293.044537:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46968 00000020:00000080:2.0:1787365293.044545:0:13010:0:(genops.c:885:class_export_put()) final put ffff9f2797a78000/lustre-MDT0000-osd_UUID 00000020:01000004:2.0:1787365293.044567:0:13010:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f2797a7c800 from MGS, refs=2 00000020:01000004:2.0:1787365293.044570:0:13010:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f2797a7c800 2 00000020:01000004:2.0:1787365293.044573:0:13010:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f2797a7c800 from MGS 00000020:00000080:2.0:1787365293.044593:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787365293.044599:0:13010:0:(obd_config.c:883:class_detach()) detach on obd MGS (uuid MGS) 00000020:00000080:2.0:1787365293.044602:0:13010:0:(genops.c:885:class_export_put()) final put ffff9f2797a7d000/MGS 00000020:00000080:2.0:1787365293.044604:0:13010:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2797a7d000/MGS for MGS 00000020:01000000:2.0:1787365293.044610:0:13010:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGS (MGS) 00000020:01000000:2.0:1787365293.044684:0:13010:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-MDT0000 (flags='F') 00000020:00000080:2.0:1787365293.044689:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787365293.044694:0:13010:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-MDT0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787365293.044701:0:13010:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-MDT0000: ACTIVE ffff9f27b626e800 lustre-MDT0000-lwp-MDT0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787365293.044706:0:13010:0:(genops.c:1553:class_disconnect_exports()) OBD device 8 (ffff9f27bbec19b8) has exports, disconnecting them 00000020:00080000:2.0:1787365293.044711:0:13010:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-MDT0000: disconnecting export at 0@lo (ffff9f27b626e800), last request at 1787365049 00000020:00000080:2.0:1787365293.044715:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46a33 00000020:00080000:2.0:1787365293.044737:0:13010:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f27b626e800): rc 0 00000020:00000080:2.0:1787365293.044741:0:13010:0:(genops.c:885:class_export_put()) final put ffff9f27b626e800/lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787365293.045447:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2797a78000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787365293.045457:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27b626e800/lustre-MDT0000-lwp-MDT0000 for lustre-MDT0000-lwp-MDT0000 00010000:01000000:0.0:1787365293.046740:0:13010:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-MDT0000: client import never connected 00000100:00080000:0.0:1787365293.046748:0:13010:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787365293.046753:0:13010:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 5 00000100:00100000:0.0:1787365293.046759:0:13010:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:0.0:1787365293.046789:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f27b64d5800 for lustre-MDT0000-lwp-MDT0000 00000020:00000080:0.0:1787365293.047016:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787365293.047024:0:13010:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000020:00000080:0.0:1787365293.047029:0:13010:0:(genops.c:885:class_export_put()) final put ffff9f278fe61000/lustre-MDT0000-lwp-MDT0000_UUID 00000020:00000080:0.0:1787365293.047033:0:13010:0:(genops.c:844:class_export_destroy()) destroying export ffff9f278fe61000/lustre-MDT0000-lwp-MDT0000_UUID for lustre-MDT0000-lwp-MDT0000 00000020:01000000:0.0:1787365293.047038:0:13010:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-MDT0000 (lustre-MDT0000-lwp-MDT0000_UUID) 00000020:01000004:0.0:1787365293.047102:0:13010:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f2797a7c800 1 00000020:00000080:0.0:1787365293.047109:0:13010:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb4695a 00000020:00000080:0.0:1787365293.047116:0:13010:0:(genops.c:885:class_export_put()) final put ffff9f2797a7a800/lustre-MDT0000-osd_UUID 00000020:01000000:0.0:1787365293.047125:0:13010:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-osd (flags='') 00000020:00000080:0.0:1787365293.047133:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2797a7a800/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:00000080:0.0:1787365293.047143:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787365293.047147:0:13010:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-osd: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787365293.047150:0:13010:0:(genops.c:1558:class_disconnect_exports()) OBD device 0 (ffff9f2786aa3370) has no exports 00000020:00000080:0.0:1787365293.177133:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787365293.177155:0:13010:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00000020:00000080:0.0:1787365293.177161:0:13010:0:(genops.c:885:class_export_put()) final put ffff9f2797a7f000/lustre-MDT0000-osd_UUID 00000020:00000080:0.0:1787365293.177165:0:13010:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2797a7f000/lustre-MDT0000-osd_UUID for lustre-MDT0000-osd 00000020:01000000:0.0:1787365293.177181:0:13010:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-osd (lustre-MDT0000-osd_UUID) 00000020:01000004:0.0:1787365293.177320:0:13010:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f2797a7a000 00000020:01000000:0.0:1787365293.177338:0:13010:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MDS (flags='F') 00000020:00000080:0.0:1787365293.177342:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787365293.177346:0:13010:0:(obd_config.c:956:class_cleanup()) MDS: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787365293.177350:0:13010:0:(genops.c:1558:class_disconnect_exports()) OBD device 3 (ffff9f27872bcd28) has no exports 00000100:00100000:2.0:1787365293.178789:0:6704:0:(service.c:3183:ptlrpc_main()) mdt00_003: service thread [ffff9f26847ec800:6704] 3 exiting: rc = 0 00000100:00100000:0.0:1787365293.178794:0:5835:0:(service.c:3183:ptlrpc_main()) mdt00_002: service thread [ffff9f27abe04600:5835] 2 exiting: rc = 0 00000100:00100000:2.0:1787365293.178935:0:5834:0:(service.c:3183:ptlrpc_main()) mdt00_001: service thread [ffff9f2787301e00:5834] 1 exiting: rc = 0 00000100:00100000:1.0:1787365293.180918:0:5833:0:(service.c:3183:ptlrpc_main()) mdt00_000: service thread [ffff9f27abe05400:5833] 0 exiting: rc = 1 00000100:00100000:2.0:1787365293.186641:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.186653:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.186663:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.186672:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.186681:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.186692:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.186700:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.186712:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.186723:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.186735:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.186746:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.186756:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.186763:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.186768:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.186775:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.186781:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187039:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187049:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187056:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187062:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187071:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187080:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187088:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187096:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187104:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187112:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187119:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187126:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187133:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187140:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187148:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187168:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187176:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187183:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187192:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187199:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187207:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187218:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187228:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187237:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187242:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187247:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187258:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187266:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187272:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187278:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187283:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187289:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187296:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187304:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187313:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187322:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187329:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187337:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187345:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187352:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187360:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187368:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187376:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187383:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187393:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187402:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187411:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.187420:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.191688:0:5837:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_001: service thread [ffff9f27abe04400:5837] 1 exiting: rc = 0 00000100:00100000:2.0:1787365293.191770:0:11946:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_002: service thread [ffff9f2686aa6400:11946] 2 exiting: rc = 0 00000100:00100000:0.0:1787365293.192366:0:5836:0:(service.c:3183:ptlrpc_main()) mdt_rdpg00_000: service thread [ffff9f27abe05200:5836] 0 exiting: rc = 1 00000100:00100000:2.0:1787365293.192761:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192776:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192782:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192797:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192802:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192807:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192812:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192817:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192822:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192827:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192834:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192840:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192846:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192851:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192856:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192873:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192883:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192898:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192909:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192918:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192923:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192928:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192939:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192947:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192953:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192962:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192967:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192973:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192980:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192987:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192993:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.192998:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193002:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193007:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193012:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193017:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193030:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193035:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193041:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193046:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193051:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193057:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193063:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193068:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193074:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193079:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193084:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193090:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193094:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193099:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193104:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193109:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193117:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193124:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193131:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193138:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193145:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193152:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193160:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193167:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193175:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193183:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193190:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365293.193198:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.193831:0:5839:0:(service.c:3183:ptlrpc_main()) mdt_out00_001: service thread [ffff9f2789343000:5839] 1 exiting: rc = 0 00000100:00100000:0.0:1787365293.193979:0:5838:0:(service.c:3183:ptlrpc_main()) mdt_out00_000: service thread [ffff9f2789342c00:5838] 0 exiting: rc = 1 00000100:00100000:0.0:1787365293.194047:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194083:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194098:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194108:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194119:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194132:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194150:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194156:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194162:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194297:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194307:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194316:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194324:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194355:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194366:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194375:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194383:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194391:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194399:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194407:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194416:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194428:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194441:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194448:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194461:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194484:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194492:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194497:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194504:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194509:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194515:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194521:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194527:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194532:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194549:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194554:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194560:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194581:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194588:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194594:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194734:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194745:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194754:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194764:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194772:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194780:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194788:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194797:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194810:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194848:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194857:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194876:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194882:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194888:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194894:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194900:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194907:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194913:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194919:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194924:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194930:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.194936:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.195215:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365293.195229:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.233555:0:5841:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0001: service thread [ffff9f27872e1e00:5841] 1 exiting: rc = 0 00000100:00100000:0.0:1787365293.236447:0:5840:0:(service.c:3183:ptlrpc_main()) mdt_seqs_0000: service thread [ffff9f27872e0800:5840] 0 exiting: rc = 1 00000100:00100000:1.0:1787365293.236692:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236702:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236708:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236714:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236720:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236726:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236732:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236738:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236744:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236750:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236756:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236761:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236767:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236772:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236778:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236783:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236789:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236794:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236800:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236805:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236810:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236815:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236821:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236826:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236831:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236837:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236842:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236847:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236852:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236858:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236879:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236903:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236908:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236913:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236919:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236924:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236930:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236935:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236940:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236944:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236949:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236954:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236959:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236964:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236970:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236975:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236981:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.236985:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.237203:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.237208:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.237214:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.237220:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.237225:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.237230:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.237236:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.237241:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.237246:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.237251:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.237257:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.237262:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.237268:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.237273:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.237278:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.237284:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.239461:0:5843:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0001: service thread [ffff9f27872e1a00:5843] 1 exiting: rc = 0 00000100:00100000:3.0:1787365293.239566:0:5842:0:(service.c:3183:ptlrpc_main()) mdt_seqm_0000: service thread [ffff9f27872e0e00:5842] 0 exiting: rc = 1 00000100:00100000:1.0:1787365293.239934:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.239942:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.239967:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.239972:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.239978:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.239983:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.239987:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.239993:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.239998:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240003:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240007:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240013:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240018:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240023:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240028:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240032:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240037:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240042:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240046:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240050:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240055:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240060:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240065:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240069:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240075:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240080:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240085:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240090:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240094:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240099:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240104:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240109:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240114:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240118:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240124:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240128:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240133:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240147:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240152:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240158:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240163:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240167:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240172:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240176:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240180:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240184:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240188:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240192:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240196:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240201:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240205:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240210:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240215:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240220:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240226:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240231:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240237:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240244:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240250:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240255:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240261:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240265:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240270:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240274:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.240694:0:5844:0:(service.c:3183:ptlrpc_main()) mdt_fld_0000: service thread [ffff9f27872e1200:5844] 0 exiting: rc = 1 00000100:00100000:3.0:1787365293.241281:0:5845:0:(service.c:3183:ptlrpc_main()) mdt_fld_0001: service thread [ffff9f27872e1600:5845] 1 exiting: rc = 0 00000100:00100000:1.0:1787365293.241595:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241603:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241608:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241612:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241617:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241622:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241646:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241662:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241667:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241672:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241678:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241684:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241690:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241696:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241701:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241707:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241712:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241716:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241722:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241726:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241732:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241737:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241742:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241747:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241753:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241758:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241763:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241768:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241774:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241778:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241784:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241789:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241793:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241799:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241805:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241810:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241815:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241820:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241825:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241830:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241835:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241840:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241854:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241859:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241876:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241881:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241886:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241891:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241897:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241902:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241906:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241911:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241915:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241920:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241924:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241928:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241932:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241937:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241942:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241946:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241950:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241954:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241959:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.241963:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365293.250517:0:5847:0:(service.c:3183:ptlrpc_main()) mdt_io00_001: service thread [ffff9f27872de800:5847] 1 exiting: rc = 0 00000100:00100000:1.0:1787365293.250788:0:5848:0:(service.c:3183:ptlrpc_main()) mdt_io00_002: service thread [ffff9f2797b4ea00:5848] 2 exiting: rc = 0 00000100:00100000:3.0:1787365293.256912:0:5846:0:(service.c:3183:ptlrpc_main()) mdt_io00_000: service thread [ffff9f27872df800:5846] 0 exiting: rc = 1 00000100:00100000:3.0:1787365293.257063:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257391:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257399:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257405:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257412:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257417:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257423:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257429:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257435:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257441:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257447:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257454:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257469:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257476:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257481:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257487:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257493:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257499:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257504:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257510:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257515:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257521:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257526:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257545:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257551:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257557:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257563:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257570:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257576:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257582:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257589:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257595:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257600:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257606:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257611:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257617:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257664:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257671:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257676:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257681:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257686:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257692:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257697:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257702:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257741:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257749:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257754:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257759:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257765:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257771:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257777:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257783:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257788:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257793:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257798:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257805:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257811:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257817:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257830:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257836:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257841:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257847:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257852:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365293.257858:0:13010:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:3.0:1787365293.270697:0:13010:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787365293.270709:0:13010:0:(obd_config.c:883:class_detach()) detach on obd MDS (uuid MDS_uuid) 00000020:00000080:3.0:1787365293.270715:0:13010:0:(genops.c:885:class_export_put()) final put ffff9f27860e0800/MDS_uuid 00000020:00000080:3.0:1787365293.270720:0:13010:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27860e0800/MDS_uuid for MDS 00000020:01000000:3.0:1787365293.270730:0:13010:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MDS (MDS_uuid) 00000020:02000400:3.0:1787365293.270882:0:13010:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-MDT0000 complete 00010000:00010000:2.0:1787365293.432824:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365294.450789:0:13011:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365295.474795:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:2.0:1787365295.561823:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:2.0:1787365295.561835:0:6707:0:(genops.c:885:class_export_put()) final put ffff9f27bf098000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787365295.561945:0:8:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27bf098000/lustre-MDT0000-mdtlov_UUID for lustre-OST0000 00000020:00000080:3.0:1787365295.562009:0:8:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f27bf09a000 for lustre-OST0000 00000100:00100000:0.0:1787365295.988083:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024502144:0@lo:400:kworker.0 00000400:00000100:0.0:1787365295.988161:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874188024502144 offset 0 length 224: 4 00000100:00100000:1.0:1787365295.988337:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbadbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024502272:0@lo:400:kworker.0 00000400:00000100:1.0:1787365295.988366:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874188024502272 offset 0 length 224: 4 00000100:00100000:1.0:1787365295.988384:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787365295.988389:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024502400:0@lo:400:kworker.0 00000400:00000100:1.0:1787365295.988416:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874188024502400 offset 0 length 224: 4 00010000:00010000:2.0:1787365296.501660:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787365296.569407:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000020:00000080:1.0:1787365296.569421:0:7624:0:(genops.c:885:class_export_put()) final put ffff9f2685881000/lustre-MDT0000-mdtlov_UUID 00000020:00000080:3.0:1787365296.569942:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2685881000/lustre-MDT0000-mdtlov_UUID for lustre-OST0001 00000020:00000080:3.0:1787365296.570008:0:12661:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f2685882800 for lustre-OST0001 00000020:01000004:0.0:1787365297.473946:0:13161:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:0.0:1787365297.506238:0:13161:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0000 00010000:00010000:0.0:1787365297.506306:0:13161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46c9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ca2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365297.506324:0:13161:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46c9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46ca2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365297.506332:0:13161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46c9b lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x872d29295eb46ca2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365297.506340:0:13161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46c9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000400000000 nid: local remote: 0x872d29295eb46ca2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365297.506372:0:13161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:0.0:1787365297.506381:0:13161:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:0.0:1787365297.506410:0:13161:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787365297.506426:0:13161:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f27bbadbb80 x1874188024502272/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365311 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365297.506454:0:13161:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 3 00000100:00080000:0.0:1787365297.506473:0:13161:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:0.0:1787365297.506508:0:13161:0:(import.c:65:import_set_state_nolock()) ffff9f2684c5a800 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:2.0:1787365297.506813:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbadbb80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024502272:0@lo:400:kworker.0 00000100:00100000:3.0:1787365297.506914:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2798098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874188024502528:0@lo:39:umount.0 00000400:00000100:3.0:1787365297.506981:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874188024502528 offset 0 length 224: 4 00010000:00010000:1.0:1787365297.507401:0:13011:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365297.507429:0:13011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46c9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x872d29295eb46ca2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365297.507441:0:13011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cc000 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:1.0:1787365297.507445:0:13011:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46c9b lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000400000000 nid: local remote: 0x872d29295eb46ca2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365297.507470:0:13011:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46c9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1008400000000 nid: local remote: 0x872d29295eb46ca2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787365297.507480:0:13011:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46c9b lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1009400000000 nid: local remote: 0x872d29295eb46ca2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365297.507486:0:13011:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787365297.507489:0:13011:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:1.0:1787365297.507492:0:13011:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:1.0:1787365297.507530:0:13011:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46c9b lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x872d29295eb46ca2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365297.507538:0:13011:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787365297.507581:0:13011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46c9b lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x872d29295eb46ca2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365297.507589:0:13011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc000/0x872d29295eb46c9b lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x5809400000020 nid: local remote: 0x872d29295eb46ca2 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365297.507603:0:13011:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365297.507605:0:13011:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365297.507607:0:13011:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365297.507759:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787365297.507783:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb40b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024502656:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787365297.507842:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365297.508173:0:8434:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024502656 00000100:00100000:1.0:1787365297.508183:0:8434:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024502656 00000100:00100000:1.0:1787365297.508234:0:8434:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787365297.508251:0:8434:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3311:x1874188024502656:12345-0@lo:103:ldlm_bl.0 00010000:00020000:1.0:1787365297.508258:0:8434:0:(ldlm_lockd.c:2564:ldlm_cancel_handler()) ldlm_cancel from 0@lo arrived at 1787365297 with bad export cookie 9740486826731530628 00000100:00100000:0.0:1787365297.520138:0:8434:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf90a80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_003:0+-99:3311:x1874188024502656:12345-0@lo:103:ldlm_bl.0 Request processed in 11872us (12290us total) trans 0 rc -107/-107 00000100:00100000:0.0:1787365297.520159:0:8434:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00080000:2.0:1787365297.521097:0:3311:0:(recover.c:205:ptlrpc_request_handle_notconn()) import MGC192.168.203.113@tcp of MGS@0@lo abruptly disconnected: reconnecting 00000100:00080000:2.0:1787365297.521129:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9f27860e7800 MGS: changing import state from FULL to DISCONN 00000100:02020000:2.0:1787365297.521135:0:3311:0:(import.c:186:ptlrpc_set_import_discon()) MGC192.168.203.113@tcp: Connection to MGS (at 0@lo) was lost; in progress operations using this service will fail 00010000:00010000:0.0:1787365297.522880:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787365297.562238:0:3311:0:(import.c:192:ptlrpc_set_import_discon()) import MGS@0@lo for MGC192.168.203.113@tcp not replayable, auto-deactivating 00000100:00080000:2.0:1787365297.562245:0:3311:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:2.0:1787365297.562258:0:3311:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f27bbada300 x1874188024502144/t0(0) o400->MGC192.168.203.113@tcp@0@lo:26/25 lens 224/224 e 0 to 0 dl 1787365311 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365297.562276:0:3311:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f27bb40b100 x1874188024502656/t0(0) o103->MGC192.168.203.113@tcp@0@lo:17/18 lens 328/224 e 0 to 0 dl 1787365313 ref 1 fl Rpc:RQU/200/0 rc 0/-107 job:'ldlm_bl.0' uid:0 gid:0 projid:4294967295 10000000:01000000:2.0:1787365297.562286:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:2.0:1787365297.562289:0:3311:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:2.0:1787365297.562291:0:3311:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:2.0:1787365297.562296:0:3311:0:(import.c:65:import_set_state_nolock()) ffff9f27860e7800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787365297.562302:0:3311:0:(import.c:510:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 165 00000100:00080000:2.0:1787365297.562314:0:3311:0:(import.c:624:import_select_connection()) MGC192.168.203.113@tcp: import ffff9f27860e7800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1787365297.564390:0:3311:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f27baf92680 x1874188024502784/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787365297.564458:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024502144:0@lo:400:kworker.0 00000100:00100000:3.0:1787365297.564502:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb40b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:65f8cd6c-cad4-438a-a88d-c44efaabba70:3311:1874188024502656:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787365297.566092:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:65f8cd6c-cad4-438a-a88d-c44efaabba70:3309:1874188024502784:0@lo:250:ptlrpcd_00_01.0 00000400:00000100:0.0:1787365297.566180:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874188024502784 offset 0 length 520: 4 00010000:00010000:2.0:1787365298.547127:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365299.573297:0:13011:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365300.595564:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787365301.108678:0:12661:0:(pinger.c:229:ptlrpc_pinger_process_import()) 65f8cd6c-cad4-438a-a88d-c44efaabba70->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787365301.108687:0:12661:0:(pinger.c:247:ptlrpc_pinger_process_import()) 65f8cd6c-cad4-438a-a88d-c44efaabba70->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:0.0:1787365301.108996:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874188024502912:0@lo:400:kworker.0 00000400:00000100:0.0:1787365301.109044:0:3311:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874188024502912 offset 0 length 224: 4 00010000:00010000:3.0:1787365301.618915:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787365302.131580:0:12661:0:(pinger.c:229:ptlrpc_pinger_process_import()) 65f8cd6c-cad4-438a-a88d-c44efaabba70->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787365302.131590:0:12661:0:(pinger.c:247:ptlrpc_pinger_process_import()) 65f8cd6c-cad4-438a-a88d-c44efaabba70->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:1.0:1787365302.131748:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:1.0:1787365302.131768:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024503040:0@lo:400:kworker.0 00000400:00000100:1.0:1787365302.131835:0:3313:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874188024503040 offset 0 length 224: 4 00010000:00010000:1.0:1787365302.643807:0:13011:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365303.669644:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365304.691697:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365305.715221:0:13011:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365306.739184:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787365307.253776:0:12661:0:(pinger.c:229:ptlrpc_pinger_process_import()) 65f8cd6c-cad4-438a-a88d-c44efaabba70->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787365307.253786:0:12661:0:(pinger.c:247:ptlrpc_pinger_process_import()) 65f8cd6c-cad4-438a-a88d-c44efaabba70->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787365307.253915:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787365307.253939:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024503168:0@lo:400:kworker.0 00000400:00000100:3.0:1787365307.253994:0:3312:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874188024503168 offset 0 length 224: 4 00000100:00100000:1.0:1787365307.764085:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787365297/real 1787365297] req@ffff9f27baf92680 x1874188024502784/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787365307 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365307.764116:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f27baf92680 x1874188024502784/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 1 dl 1787365307 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'ptlrpcd_00_01.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365307.764126:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787365297/real 1787365297] req@ffff9f2798098e00 x1874188024502528/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787365307 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365307.764144:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f2798098e00 x1874188024502528/t0(0) o39->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787365307 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787365307.764161:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9f27860e7800 MGS: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787365307.764180:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of MGS on 0@lo failed (-110) 00000100:00100000:1.0:1787365307.764185:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:65f8cd6c-cad4-438a-a88d-c44efaabba70:3309:1874188024502784:0@lo:250:ptlrpcd_00_01.0 00000100:00080000:1.0:1787365307.764191:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9f2684c5a800 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787365307.764202:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2798098e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874188024502528:0@lo:39:umount.0 00000100:00080000:3.0:1787365307.764287:0:12661:0:(pinger.c:229:ptlrpc_pinger_process_import()) 65f8cd6c-cad4-438a-a88d-c44efaabba70->MGS: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:3.0:1787365307.764292:0:12661:0:(pinger.c:237:ptlrpc_pinger_process_import()) MGS: starting recovery 00000100:00080000:3.0:1787365307.764295:0:12661:0:(import.c:65:import_set_state_nolock()) ffff9f27860e7800 MGS: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787365307.764299:0:12661:0:(import.c:510:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 414 00000100:00080000:3.0:1787365307.764304:0:12661:0:(import.c:589:import_select_connection()) MGC192.168.203.113@tcp: tried all connections, increasing latency to 5s 00000100:00080000:3.0:1787365307.764309:0:12661:0:(import.c:624:import_select_connection()) MGC192.168.203.113@tcp: import ffff9f27860e7800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1787365307.764345:0:12661:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f27baf93480 x1874188024503296/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787365307.764470:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:65f8cd6c-cad4-438a-a88d-c44efaabba70:3309:1874188024503296:0@lo:250:kworker.0 00000400:00000100:1.0:1787365307.764522:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 26 match 1874188024503296 offset 0 length 520: 4 00000100:00080000:0.0:1787365307.766067:0:13161:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:0.0:1787365307.766074:0:13161:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 4 00000100:00100000:0.0:1787365307.766082:0:13161:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:3.0:1787365307.766399:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365307.767021:0:13161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46ca9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46cb0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365307.767036:0:13161:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46ca9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46cb0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365307.767044:0:13161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46ca9 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x872d29295eb46cb0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365307.767051:0:13161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46ca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000400000000 nid: local remote: 0x872d29295eb46cb0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365307.767076:0:13161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787365307.767082:0:13161:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46ed2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ed9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365307.767089:0:13161:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46ed2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46ed9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365307.767095:0:13161:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46ed2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x872d29295eb46ed9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365307.767102:0:13161:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46ed2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x872d29295eb46ed9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365307.767134:0:13161:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:0.0:1787365307.767138:0:13161:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0000 (0) 00000020:01000004:0.0:1787365307.767159:0:13161:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0000 00000020:01000000:0.0:1787365307.767163:0:13161:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000 (flags='F') 00000020:00000080:0.0:1787365307.767167:0:13161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787365307.767171:0:13161:0:(obd_config.c:956:class_cleanup()) lustre-OST0000: forcing exports to disconnect: 0/1 00000020:00080000:0.0:1787365307.767175:0:13161:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9f2786aa0000) has no exports 00000020:00080000:0.0:1787365307.767196:0:13161:0:(genops.c:1558:class_disconnect_exports()) OBD device 11 (ffff9f2786aa0000) has no exports 00010000:00010000:1.0:1787365307.767404:0:13011:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787365307.767411:0:13011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46ca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x872d29295eb46cb0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365307.767420:0:13011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cc400 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:1.0:1787365307.767424:0:13011:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46ca9 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000400000000 nid: local remote: 0x872d29295eb46cb0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365307.767433:0:13011:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46ca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1008400000000 nid: local remote: 0x872d29295eb46cb0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787365307.767450:0:13011:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46ca9 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1009400000000 nid: local remote: 0x872d29295eb46cb0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365307.767456:0:13011:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787365307.767459:0:13011:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0000: stopping, won't requeue 10000000:01000000:1.0:1787365307.767462:0:13011:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0000 00010000:00010000:1.0:1787365307.767476:0:13011:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f27860e7800 00010000:00010000:1.0:1787365307.767480:0:13011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46ca9 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x872d29295eb46cb0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365307.767495:0:13011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc400/0x872d29295eb46ca9 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x5809400000000 nid: local remote: 0x872d29295eb46cb0 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365307.767509:0:13011:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365307.767512:0:13011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46ed2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x872d29295eb46ed9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365307.767529:0:13011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030e00 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:1.0:1787365307.767532:0:13011:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46ed2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x872d29295eb46ed9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365307.767539:0:13011:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46ed2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x872d29295eb46ed9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787365307.767545:0:13011:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46ed2 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x872d29295eb46ed9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365307.767550:0:13011:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787365307.767552:0:13011:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787365307.767554:0:13011:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787365307.767559:0:13011:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f27860e7800 00010000:00010000:1.0:1787365307.767562:0:13011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46ed2 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x872d29295eb46ed9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365307.767567:0:13011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f2780030e00/0x872d29295eb46ed2 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x872d29295eb46ed9 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365307.767576:0:13011:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365307.767577:0:13011:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365307.767579:0:13011:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365307.768888:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:0.0:1787365307.770460:0:13161:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f2788e3fd20 - data ffff9f27bfe34000/ffff9f27bb1f5000 00000020:01000000:0.0:1787365307.770650:0:13161:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f2788e3f180 - data ffff9f27b2f42d80/ffff9f26846d8400 00100000:10000000:0.0:1787365307.789830:0:13161:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0000-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:2.0:1787365307.806701:0:13161:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46ab8 00000020:00000080:2.0:1787365307.806711:0:13161:0:(genops.c:885:class_export_put()) final put ffff9f278835b800/lustre-OST0000-osd_UUID 00000020:01000004:2.0:1787365307.806726:0:13161:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f27a01d6000 from lustre-OST0000, refs=2 00000020:01000004:2.0:1787365307.806730:0:13161:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f27a01d6000 2 00000020:01000004:2.0:1787365307.806733:0:13161:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f27a01d6000 from lustre-OST0000 00000020:00000080:2.0:1787365307.806758:0:13161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:2.0:1787365307.806775:0:13161:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:00000080:2.0:1787365307.806779:0:13161:0:(genops.c:885:class_export_put()) final put ffff9f278835d000/lustre-OST0000_UUID 00000020:00000080:2.0:1787365307.806782:0:13161:0:(genops.c:844:class_export_destroy()) destroying export ffff9f278835d000/lustre-OST0000_UUID for lustre-OST0000 00000020:01000000:2.0:1787365307.806790:0:13161:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000 (lustre-OST0000_UUID) 00000020:01000004:2.0:1787365307.806827:0:13161:0:(obd_mount.c:578:lustre_stop_mgc()) MGC still has 1 references. 00000020:01000000:2.0:1787365307.806832:0:13161:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0000 (flags='F') 00000020:00000080:2.0:1787365307.806835:0:13161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787365307.806840:0:13161:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0000: forcing exports to disconnect: 1/3 00000020:00080000:2.0:1787365307.806857:0:13161:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0000: ACTIVE ffff9f2684c58800 lustre-MDT0000-lwp-OST0000 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:2.0:1787365307.806862:0:13161:0:(genops.c:1553:class_disconnect_exports()) OBD device 12 (ffff9f27bbec0000) has exports, disconnecting them 00000020:00080000:2.0:1787365307.806868:0:13161:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0000: disconnecting export at 0@lo (ffff9f2684c58800), last request at 1787365066 00000020:00000080:2.0:1787365307.806871:0:13161:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46ae2 00000020:00080000:2.0:1787365307.806882:0:13161:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f2684c58800): rc 0 00000020:00000080:2.0:1787365307.806887:0:13161:0:(genops.c:885:class_export_put()) final put ffff9f2684c58800/lustre-MDT0000-lwp-OST0000 00000020:00000080:3.0:1787365307.807730:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f278835b800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:3.0:1787365307.807745:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2684c58800/lustre-MDT0000-lwp-OST0000 for lustre-MDT0000-lwp-OST0000 00010000:01000000:3.0:1787365307.828240:0:13161:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0000: client import never connected 00000100:00080000:3.0:1787365307.828248:0:13161:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:3.0:1787365307.828253:0:13161:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 5 00000100:00100000:3.0:1787365307.828260:0:13161:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00000020:00000080:3.0:1787365307.828473:0:13161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:3.0:1787365307.828483:0:13161:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000020:01000004:3.0:1787365307.828490:0:13161:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f27a01d6000 1 00000020:00000080:3.0:1787365307.828497:0:13161:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46a72 00000020:00000080:3.0:1787365307.828506:0:13161:0:(genops.c:885:class_export_put()) final put ffff9f27892ff800/lustre-OST0000-osd_UUID 00000020:01000000:3.0:1787365307.828512:0:13161:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0000-osd (flags='') 00000020:00000080:3.0:1787365307.828528:0:13161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:3.0:1787365307.828533:0:13161:0:(obd_config.c:956:class_cleanup()) lustre-OST0000-osd: forcing exports to disconnect: 0/2 00000020:00080000:3.0:1787365307.828537:0:13161:0:(genops.c:1558:class_disconnect_exports()) OBD device 9 (ffff9f27872b99b8) has no exports 00000020:00000080:1.0:1787365307.828654:0:12661:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f2684c5a800 for lustre-MDT0000-lwp-OST0000 00000020:00000080:1.0:1787365307.828663:0:12661:0:(genops.c:885:class_export_put()) final put ffff9f26847f6000/lustre-MDT0000-lwp-OST0000_UUID 00000020:00000080:1.0:1787365307.828666:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f26847f6000/lustre-MDT0000-lwp-OST0000_UUID for lustre-MDT0000-lwp-OST0000 00000020:01000000:1.0:1787365307.828676:0:12661:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0000 (lustre-MDT0000-lwp-OST0000_UUID) 00000020:00000080:1.0:1787365307.828723:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27892ff800/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:00000080:1.0:1787365307.877172:0:13161:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787365307.877189:0:13161:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00000020:00000080:1.0:1787365307.877195:0:13161:0:(genops.c:885:class_export_put()) final put ffff9f278455c000/lustre-OST0000-osd_UUID 00000020:00000080:1.0:1787365307.877200:0:13161:0:(genops.c:844:class_export_destroy()) destroying export ffff9f278455c000/lustre-OST0000-osd_UUID for lustre-OST0000-osd 00000020:01000000:1.0:1787365307.877209:0:13161:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0000-osd (lustre-OST0000-osd_UUID) 00000020:01000004:1.0:1787365307.877359:0:13161:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f278455b800 00000020:02000400:1.0:1787365307.877404:0:13161:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0000 complete 00010000:00010000:3.0:1787365308.791967:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365309.822120:0:13011:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:1.0:1787365310.804019:0:13312:0:(tgt_mount.c:2192:server_umount_begin()) umount -f 00000020:01000004:1.0:1787365310.830912:0:13312:0:(tgt_mount.c:2062:server_put_super()) server put_super lustre-OST0001 00010000:00010000:1.0:1787365310.830983:0:13312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46c7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46c86 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365310.830997:0:13312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46c7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46c86 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365310.831005:0:13312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46c7f lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x872d29295eb46c86 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365310.831012:0:13312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46c7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000400000000 nid: local remote: 0x872d29295eb46c86 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365310.831041:0:13312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 10000000:01000000:1.0:1787365310.831046:0:13312:0:(mgc_request.c:547:config_log_end()) end config log lustre-client (0) 00000100:00080000:1.0:1787365310.831067:0:13312:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787365310.831078:0:13312:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f27bbad9500 x1874188024502400/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365311 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365310.831101:0:13312:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f27baf92d80 x1874188024502912/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365317 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365310.831112:0:13312:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f27baf93100 x1874188024503040/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365318 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365310.831223:0:13312:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f27bb408380 x1874188024503168/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365323 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365310.831233:0:13312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 3 00000100:00080000:1.0:1787365310.831238:0:13312:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:1.0:1787365310.831260:0:13312:0:(import.c:65:import_set_state_nolock()) ffff9f27882fd000 lustre-MDT0000_UUID: changing import state from FULL to CONNECTING 00000100:00100000:1.0:1787365310.831287:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb40ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874188024503424:0@lo:39:umount.0 00000400:00000100:1.0:1787365310.831334:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 12 match 1874188024503424 offset 0 length 224: 4 00000100:00100000:0.0:1787365310.831444:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb408380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024503168:0@lo:400:kworker.0 00000100:00100000:0.0:1787365310.831453:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbad9500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024502400:0@lo:400:kworker.0 00000100:00100000:0.0:1787365310.831485:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874188024502912:0@lo:400:kworker.0 00010000:00010000:3.0:1787365310.831608:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365310.831615:0:5822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46c7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x872d29295eb46c86 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365310.831650:0:5822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cd200 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:3.0:1787365310.831655:0:5822:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46c7f lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000400000000 nid: local remote: 0x872d29295eb46c86 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365310.831664:0:5822:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46c7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x872d29295eb46c86 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787365310.831671:0:5822:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46c7f lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x872d29295eb46c86 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365310.831676:0:5822:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:3.0:1787365310.831678:0:5822:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-client: stopping, won't requeue 10000000:01000000:3.0:1787365310.831680:0:5822:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-client 00010000:00010000:3.0:1787365310.831693:0:5822:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f27860e7800 00010000:00010000:3.0:1787365310.831696:0:5822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46c7f lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x872d29295eb46c86 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365310.831702:0:5822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd200/0x872d29295eb46c7f lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x872d29295eb46c86 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365310.831713:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365310.831714:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365310.831716:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365310.833730:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-OST0001_UUID:3313:1874188024503040:0@lo:400:kworker.0 00010000:00010000:3.0:1787365310.837245:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365311.860591:0:13011:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365312.886886:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:1.0:1787365312.886976:0:12661:0:(pinger.c:229:ptlrpc_pinger_process_import()) 65f8cd6c-cad4-438a-a88d-c44efaabba70->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:1.0:1787365312.886983:0:12661:0:(pinger.c:247:ptlrpc_pinger_process_import()) 65f8cd6c-cad4-438a-a88d-c44efaabba70->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:0.0:1787365313.908166:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365314.932131:0:13011:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365315.955558:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365316.979445:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365318.002979:0:13011:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:0.0:1787365318.003007:0:12661:0:(pinger.c:229:ptlrpc_pinger_process_import()) 65f8cd6c-cad4-438a-a88d-c44efaabba70->MGS: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 1 suppress 0 00000100:00080000:0.0:1787365318.003014:0:12661:0:(pinger.c:247:ptlrpc_pinger_process_import()) 65f8cd6c-cad4-438a-a88d-c44efaabba70->MGS: not pinging (in recovery or recovery disabled: CONNECTING) 00010000:00010000:3.0:1787365319.028031:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365320.050840:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787365310/real 1787365310] req@ffff9f27bb40ad80 x1874188024503424/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787365320 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365320.050884:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f27bb40ad80 x1874188024503424/t0(0) o39->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 1 dl 1787365320 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'umount.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787365320.050907:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9f27882fd000 lustre-MDT0000_UUID: changing import state from CONNECTING to CLOSED 00000100:00100000:1.0:1787365320.050937:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb40ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874188024503424:0@lo:39:umount.0 00000100:00080000:2.0:1787365320.051062:0:13312:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:2.0:1787365320.051069:0:13312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 4 00000100:00100000:2.0:1787365320.051075:0:13312:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:2.0:1787365320.052091:0:13312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46c8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46c94 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365320.052111:0:13312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46c8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46c94 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365320.052119:0:13312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46c8d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x872d29295eb46c94 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365320.052126:0:13312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46c8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000400000000 nid: local remote: 0x872d29295eb46c94 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365320.052151:0:13312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:2.0:1787365320.052157:0:13312:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2788f44000/0x872d29295eb46ec4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb46ecb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365320.052164:0:13312:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2788f44000/0x872d29295eb46ec4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb46ecb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365320.052170:0:13312:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2788f44000/0x872d29295eb46ec4 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x872d29295eb46ecb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365320.052193:0:13312:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGC192.168.203.113@tcp lock: ffff9f2788f44000/0x872d29295eb46ec4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000400000000 nid: local remote: 0x872d29295eb46ecb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365320.052209:0:13312:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 10000000:01000000:2.0:1787365320.052214:0:13312:0:(mgc_request.c:547:config_log_end()) end config log lustre-OST0001 (0) 00000020:01000004:2.0:1787365320.052244:0:13312:0:(tgt_mount.c:2112:server_put_super()) stopping lustre-OST0001 00000020:01000000:2.0:1787365320.052249:0:13312:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001 (flags='F') 00000020:00000080:2.0:1787365320.052254:0:13312:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:2.0:1787365320.052262:0:13312:0:(obd_config.c:956:class_cleanup()) lustre-OST0001: forcing exports to disconnect: 0/1 00000020:00080000:2.0:1787365320.052267:0:13312:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9f27b6ed99b8) has no exports 00000020:00080000:2.0:1787365320.052302:0:13312:0:(genops.c:1558:class_disconnect_exports()) OBD device 15 (ffff9f27b6ed99b8) has no exports 00010000:00010000:1.0:1787365320.056525:0:13011:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787365320.056544:0:13011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46c8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x872d29295eb46c94 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365320.056559:0:13011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cdc00 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:1.0:1787365320.056565:0:13011:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46c8d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000400000000 nid: local remote: 0x872d29295eb46c94 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365320.056599:0:13011:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46c8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1008400000000 nid: local remote: 0x872d29295eb46c94 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787365320.056607:0:13011:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46c8d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1009400000000 nid: local remote: 0x872d29295eb46c94 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365320.056613:0:13011:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:1.0:1787365320.056616:0:13011:0:(mgc_request.c:944:mgc_blocking_ast()) log lustre-OST0001: stopping, won't requeue 10000000:01000000:1.0:1787365320.056620:0:13011:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-OST0001 00010000:00010000:1.0:1787365320.056693:0:13011:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f27860e7800 00010000:00010000:1.0:1787365320.056698:0:13011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46c8d lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x872d29295eb46c94 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365320.056705:0:13011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a12cdc00/0x872d29295eb46c8d lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x5809400000000 nid: local remote: 0x872d29295eb46c94 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365320.056724:0:13011:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365320.056728:0:13011:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f2788f44000/0x872d29295eb46ec4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x872d29295eb46ecb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365320.056734:0:13011:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44000 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:1.0:1787365320.056737:0:13011:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f2788f44000/0x872d29295eb46ec4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000400000000 nid: local remote: 0x872d29295eb46ecb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365320.056743:0:13011:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f2788f44000/0x872d29295eb46ec4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1008400000000 nid: local remote: 0x872d29295eb46ecb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787365320.056749:0:13011:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f2788f44000/0x872d29295eb46ec4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1009400000000 nid: local remote: 0x872d29295eb46ecb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365320.056765:0:13011:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 10000000:01000000:1.0:1787365320.056767:0:13011:0:(mgc_request.c:944:mgc_blocking_ast()) log params: stopping, won't requeue 10000000:01000000:1.0:1787365320.056770:0:13011:0:(mgc_request.c:130:config_log_put()) dropping config log params 00010000:00010000:1.0:1787365320.056777:0:13011:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f27860e7800 00010000:00010000:1.0:1787365320.056780:0:13011:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f2788f44000/0x872d29295eb46ec4 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x872d29295eb46ecb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365320.056786:0:13011:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f2788f44000/0x872d29295eb46ec4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5809400000000 nid: local remote: 0x872d29295eb46ecb expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365320.056800:0:13011:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365320.056802:0:13011:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365320.056804:0:13011:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365320.057131:0:5821:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365320.057225:0:5822:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000000:2.0:1787365320.059336:0:13312:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f27a590f000 - data ffff9f27b0e9ae58/ffff9f2684732000 00000020:01000000:2.0:1787365320.060795:0:13312:0:(lprocfs_status_server.c:344:lprocfs_free_client_stats()) stat ffff9f27867a6f00 - data ffff9f27b0fc5870/ffff9f27b6c0e000 00100000:10000000:2.0:1787365320.070940:0:13312:0:(lfsck_layout.c:753:lfsck_rbtree_cleanup()) lustre-OST0001-osd: layout LFSCK fini OST-objects accessing bitmap 00000020:00000080:0.0:1787365320.109481:0:13312:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46b83 00000020:00000080:0.0:1787365320.109496:0:13312:0:(genops.c:885:class_export_put()) final put ffff9f27bb906800/lustre-OST0001-osd_UUID 00000020:01000004:0.0:1787365320.109582:0:13312:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f27882fe000 from lustre-OST0001, refs=2 00000020:01000004:0.0:1787365320.109586:0:13312:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f27882fe000 2 00000020:01000004:0.0:1787365320.109590:0:13312:0:(tgt_mount.c:120:server_deregister_mount()) deregister mount ffff9f27882fe000 from lustre-OST0001 00000020:00000080:0.0:1787365320.109621:0:13312:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787365320.109668:0:13312:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:00000080:0.0:1787365320.109700:0:13312:0:(genops.c:885:class_export_put()) final put ffff9f2794eb5800/lustre-OST0001_UUID 00000020:00000080:0.0:1787365320.109703:0:13312:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2794eb5800/lustre-OST0001_UUID for lustre-OST0001 00000020:01000000:0.0:1787365320.109712:0:13312:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001 (lustre-OST0001_UUID) 00000100:00080000:0.0:1787365320.109859:0:13312:0:(pinger.c:398:ptlrpc_pinger_del_import()) removing pingable import 65f8cd6c-cad4-438a-a88d-c44efaabba70->MGS 00010000:00010000:0.0:1787365320.109878:0:13312:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc200/0x872d29295eb46a95 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x872d29295eb46a9c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365320.109893:0:13312:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc200/0x872d29295eb46a95 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x872d29295eb46a9c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365320.109901:0:13312:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x70616d65646f6e:0x4:0x0].0x0 (nodemap) 10000000:01000000:0.0:1787365320.109904:0:13312:0:(mgc_request.c:954:mgc_blocking_ast()) log nodemap: disconnecting, won't requeue 10000000:01000000:0.0:1787365320.109908:0:13312:0:(mgc_request.c:130:config_log_put()) dropping config log nodemap 00010000:00010000:0.0:1787365320.109927:0:13312:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f27860e7800 00010000:00010000:0.0:1787365320.109932:0:13312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a12cc200/0x872d29295eb46a95 lrc: 0/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x872d29295eb46a9c expref: -99 pid: 6677 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:00000080:3.0:1787365320.110659:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27bb906800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00010000:00010000:0.0:1787365320.110771:0:13312:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a12cde00/0x872d29295eb46cda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1008400000000 nid: local remote: 0x872d29295eb46ce1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365320.110782:0:13312:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cde00/0x872d29295eb46cda lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1009400000000 nid: local remote: 0x872d29295eb46ce1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365320.110788:0:13312:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x0:0x0].0x0 (lustre) 10000000:01000000:0.0:1787365320.110791:0:13312:0:(mgc_request.c:954:mgc_blocking_ast()) log lustre-s: disconnecting, won't requeue 10000000:01000000:0.0:1787365320.110793:0:13312:0:(mgc_request.c:130:config_log_put()) dropping config log lustre-sptlrpc 00010000:00010000:0.0:1787365320.110810:0:13312:0:(ldlm_request.c:1547:ldlm_cli_cancel_req()) skipping cancel on invalid import ffff9f27860e7800 00010000:00010000:0.0:1787365320.110813:0:13312:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a12cde00/0x872d29295eb46cda lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x5809400000000 nid: local remote: 0x872d29295eb46ce1 expref: -99 pid: 5832 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787365320.110837:0:13312:0:(import.c:65:import_set_state_nolock()) ffff9f27860e7800 MGS: changing import state from CONNECTING to CLOSED 10000000:01000000:0.0:1787365320.110855:0:13312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808001 00000100:00080000:0.0:1787365320.110857:0:13312:0:(pinger.c:193:ptlrpc_pinger_ir_down()) IR down 10000000:01000000:0.0:1787365320.110859:0:13312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00080000:0.0:1787365320.110865:0:13312:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 00000100:00100000:0.0:1787365320.110879:0:13312:0:(client.c:3589:ptlrpc_abort_inflight()) @@@ inflight req@ffff9f27baf93480 x1874188024503296/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 1787365322 ref 1 fl Rpc:NQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 10000000:01000000:0.0:1787365320.110941:0:13312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787365320.110945:0:13312:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 2s for inflight to error out 00000100:00100000:1.0:1787365320.114238:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf93480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:65f8cd6c-cad4-438a-a88d-c44efaabba70:3309:1874188024503296:0@lo:250:kworker.0 10000000:01000000:0.0:1787365320.114570:0:13312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787365320.114589:0:13312:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46976 00000020:00000080:0.0:1787365320.114602:0:13312:0:(genops.c:885:class_export_put()) final put ffff9f27860e4800/65f8cd6c-cad4-438a-a88d-c44efaabba70 00000020:01000000:0.0:1787365320.115290:0:13312:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of MGC192.168.203.113@tcp (flags='') 00000020:00000080:0.0:1787365320.115302:0:13312:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787365320.115313:0:13312:0:(obd_config.c:956:class_cleanup()) MGC192.168.203.113@tcp: forcing exports to disconnect: 0/3 00000020:00080000:0.0:1787365320.115318:0:13312:0:(genops.c:1558:class_disconnect_exports()) OBD device 2 (ffff9f27872bb370) has no exports 10000000:01000000:0.0:1787365320.115352:0:5832:0:(mgc_request.c:708:mgc_requeue_thread()) Ending requeue thread 10000000:01000000:0.0:1787365320.115453:0:13312:0:(obd_class.h:670:obd_cleanup_client_import()) MGC192.168.203.113@tcp: client import never connected 00000100:00080000:0.0:1787365320.115458:0:13312:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import MGS INVALID 10000000:01000000:0.0:1787365320.115462:0:13312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808002 00000100:00100000:0.0:1787365320.115465:0:13312:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 10000000:01000000:0.0:1787365320.115467:0:13312:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808003 00000020:00000080:0.0:1787365320.115621:0:13312:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:0.0:1787365320.115654:0:13312:0:(obd_config.c:883:class_detach()) detach on obd MGC192.168.203.113@tcp (uuid 65f8cd6c-cad4-438a-a88d-c44efaabba70) 00000020:01000000:0.0:1787365320.115661:0:13312:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-MDT0000-lwp-OST0001 (flags='F') 00000020:00000080:0.0:1787365320.115664:0:13312:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:0.0:1787365320.115669:0:13312:0:(obd_config.c:956:class_cleanup()) lustre-MDT0000-lwp-OST0001: forcing exports to disconnect: 1/3 00000020:00080000:0.0:1787365320.115677:0:13312:0:(genops.c:1819:print_export_data()) lustre-MDT0000-lwp-OST0001: ACTIVE ffff9f27bb324800 lustre-MDT0000-lwp-OST0001 0@lo 3 (0 0 0) 0 0 0 0: 0000000000000000 0 stale:0 00000020:00080000:0.0:1787365320.115692:0:13312:0:(genops.c:1553:class_disconnect_exports()) OBD device 16 (ffff9f27bbec3370) has exports, disconnecting them 00000020:00080000:0.0:1787365320.115697:0:13312:0:(genops.c:1528:class_disconnect_export_list()) lustre-MDT0000-lwp-OST0001: disconnecting export at 0@lo (ffff9f27bb324800), last request at 1787365086 00000020:00000080:0.0:1787365320.115703:0:13312:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46bad 00000020:00080000:0.0:1787365320.115718:0:13312:0:(genops.c:1533:class_disconnect_export_list()) disconnected export at 0@lo (ffff9f27bb324800): rc 0 00000020:00000080:0.0:1787365320.115723:0:13312:0:(genops.c:885:class_export_put()) final put ffff9f27bb324800/lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787365320.115934:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27860e4800/65f8cd6c-cad4-438a-a88d-c44efaabba70 for MGC192.168.203.113@tcp 00000020:00000080:3.0:1787365320.116477:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27bb324800/lustre-MDT0000-lwp-OST0001 for lustre-MDT0000-lwp-OST0001 00000020:00000080:3.0:1787365320.117475:0:12661:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f27860e7800 for MGC192.168.203.113@tcp 00000020:00000080:3.0:1787365320.117487:0:12661:0:(genops.c:885:class_export_put()) final put ffff9f27860e6000/65f8cd6c-cad4-438a-a88d-c44efaabba70 00000020:00000080:3.0:1787365320.117491:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27860e6000/65f8cd6c-cad4-438a-a88d-c44efaabba70 for MGC192.168.203.113@tcp 00000020:01000000:3.0:1787365320.117507:0:12661:0:(genops.c:441:class_free_dev()) finishing cleanup of obd MGC192.168.203.113@tcp (65f8cd6c-cad4-438a-a88d-c44efaabba70) 00010000:01000000:1.0:1787365320.118127:0:13312:0:(obd_class.h:670:obd_cleanup_client_import()) lustre-MDT0000-lwp-OST0001: client import never connected 00000100:00080000:1.0:1787365320.118134:0:13312:0:(import.c:138:ptlrpc_deactivate_import_nolock()) setting import lustre-MDT0000_UUID INVALID 00000100:00100000:1.0:1787365320.118139:0:13312:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 5 00000100:00100000:1.0:1787365320.118146:0:13312:0:(import.c:323:ptlrpc_invalidate_import()) Sleeping 20s for inflight to error out 00010000:00010000:1.0:1787365320.118221:0:13011:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-1 blwis in pool) 00000020:00000080:3.0:1787365320.118388:0:12661:0:(genops.c:1183:obd_zombie_import_free()) destroying import ffff9f27882fd000 for lustre-MDT0000-lwp-OST0001 00010000:00010000:1.0:1787365320.119742:0:5821:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-2 blwis in pool) 00010000:00010000:1.0:1787365320.120113:0:5822:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 0 locks of 0 total in blp. (-3 blwis in pool) 00000100:00100000:1.0:1787365320.120294:0:5817:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_001: service thread [ffff9f2789352400:5817] 1 exiting: rc = 0 00000100:00100000:1.0:1787365320.121834:0:5816:0:(service.c:3183:ptlrpc_main()) ldlm_cb00_000: service thread [ffff9f278470b000:5816] 0 exiting: rc = 1 00000100:00100000:3.0:1787365320.122142:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.122527:0:5819:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_001: service thread [ffff9f2789352a00:5819] 1 exiting: rc = 0 00000100:00100000:1.0:1787365320.122604:0:5820:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_002: service thread [ffff9f2789352200:5820] 2 exiting: rc = 0 00000100:00100000:3.0:1787365320.122816:0:5818:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_000: service thread [ffff9f2789353600:5818] 0 exiting: rc = 1 00000100:00100000:1.0:1787365320.123819:0:8434:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_003: service thread [ffff9f27b6a2ba00:8434] 3 exiting: rc = 0 00000100:00100000:3.0:1787365320.125829:0:8435:0:(service.c:3183:ptlrpc_main()) ldlm_cn00_004: service thread [ffff9f2686cbba00:8435] 4 exiting: rc = 0 00000100:00100000:1.0:1787365320.133268:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133284:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133315:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133324:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133330:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133336:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133342:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133349:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133357:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133364:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133371:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133378:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133385:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133392:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133408:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133416:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133423:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133430:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133435:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133441:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133449:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133454:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133460:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133466:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133471:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133477:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133483:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133489:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133494:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133500:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133506:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133511:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133518:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133523:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133527:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133533:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133539:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133554:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133560:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133567:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133572:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133578:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133584:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133590:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133595:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133600:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133606:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133613:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133618:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133820:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133829:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133836:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133842:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133848:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133855:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133860:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133866:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133872:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133878:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133884:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133891:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133896:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133902:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.133907:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:00000080:1.0:1787365320.141140:0:13312:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787365320.141160:0:13312:0:(obd_config.c:883:class_detach()) detach on obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000020:00000080:1.0:1787365320.141168:0:13312:0:(genops.c:885:class_export_put()) final put ffff9f26847f2800/lustre-MDT0000-lwp-OST0001_UUID 00000020:00000080:1.0:1787365320.141175:0:13312:0:(genops.c:844:class_export_destroy()) destroying export ffff9f26847f2800/lustre-MDT0000-lwp-OST0001_UUID for lustre-MDT0000-lwp-OST0001 00000020:01000000:1.0:1787365320.141189:0:13312:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-MDT0000-lwp-OST0001 (lustre-MDT0000-lwp-OST0001_UUID) 00000020:01000004:1.0:1787365320.141266:0:13312:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f27882fe000 1 00000020:00000080:1.0:1787365320.141275:0:13312:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb46b52 00000020:00000080:1.0:1787365320.141296:0:13312:0:(genops.c:885:class_export_put()) final put ffff9f278835e800/lustre-OST0001-osd_UUID 00000020:01000000:1.0:1787365320.141321:0:13312:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of lustre-OST0001-osd (flags='') 00000020:00000080:1.0:1787365320.141326:0:13312:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787365320.141333:0:13312:0:(obd_config.c:956:class_cleanup()) lustre-OST0001-osd: forcing exports to disconnect: 0/2 00000020:00080000:1.0:1787365320.141337:0:13312:0:(genops.c:1558:class_disconnect_exports()) OBD device 14 (ffff9f27b6edcd28) has no exports 00000020:00000080:3.0:1787365320.142086:0:12661:0:(genops.c:844:class_export_destroy()) destroying export ffff9f278835e800/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:00000080:1.0:1787365320.171897:0:13312:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787365320.171922:0:13312:0:(obd_config.c:883:class_detach()) detach on obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00000020:00000080:1.0:1787365320.171930:0:13312:0:(genops.c:885:class_export_put()) final put ffff9f2794eb5000/lustre-OST0001-osd_UUID 00000020:00000080:1.0:1787365320.171936:0:13312:0:(genops.c:844:class_export_destroy()) destroying export ffff9f2794eb5000/lustre-OST0001-osd_UUID for lustre-OST0001-osd 00000020:01000000:1.0:1787365320.171964:0:13312:0:(genops.c:441:class_free_dev()) finishing cleanup of obd lustre-OST0001-osd (lustre-OST0001-osd_UUID) 00000020:01000004:1.0:1787365320.172214:0:13312:0:(obd_mount.c:668:lustre_free_lsi()) Freeing lsi ffff9f27bbecb000 00000020:01000000:1.0:1787365320.175595:0:13312:0:(obd_config.c:2477:class_manual_cleanup()) Manual cleanup of OSS (flags='F') 00000020:00000080:1.0:1787365320.175709:0:13312:0:(obd_config.c:1472:class_process_config()) processing cmd: cf004 00000020:00000080:1.0:1787365320.175726:0:13312:0:(obd_config.c:956:class_cleanup()) OSS: forcing exports to disconnect: 0/1 00000020:00080000:1.0:1787365320.175733:0:13312:0:(genops.c:1558:class_disconnect_exports()) OBD device 10 (ffff9f2786aa19b8) has no exports 00000020:00000080:1.0:1787365320.175787:0:13312:0:(obd_config.c:1472:class_process_config()) processing cmd: cf002 00000020:00000080:1.0:1787365320.175806:0:13312:0:(obd_config.c:883:class_detach()) detach on obd OSS (uuid OSS_uuid) 00000020:00000080:1.0:1787365320.175812:0:13312:0:(genops.c:885:class_export_put()) final put ffff9f27892fb800/OSS_uuid 00000020:00000080:1.0:1787365320.175817:0:13312:0:(genops.c:844:class_export_destroy()) destroying export ffff9f27892fb800/OSS_uuid for OSS 00000020:01000000:1.0:1787365320.175828:0:13312:0:(genops.c:441:class_free_dev()) finishing cleanup of obd OSS (OSS_uuid) 00000100:00100000:3.0:1787365320.176109:0:6680:0:(service.c:3183:ptlrpc_main()) ll_ost00_000: service thread [ffff9f27bae8d400:6680] 0 exiting: rc = 1 00000100:00100000:1.0:1787365320.181766:0:10260:0:(service.c:3183:ptlrpc_main()) ll_ost00_003: service thread [ffff9f27bbba4200:10260] 3 exiting: rc = 0 00000100:00080000:1.0:1787365320.181883:0:5830:0:(pinger.c:548:ping_evictor_main()) Exiting Ping Evictor 00000100:00100000:0.0:1787365320.182649:0:6682:0:(service.c:3183:ptlrpc_main()) ll_ost00_002: service thread [ffff9f27a0286800:6682] 2 exiting: rc = 0 00000100:00100000:0.0:1787365320.182736:0:6681:0:(service.c:3183:ptlrpc_main()) ll_ost00_001: service thread [ffff9f27bae8ca00:6681] 1 exiting: rc = 0 00000100:00100000:1.0:1787365320.182818:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.182832:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.182844:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.182851:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.182857:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.182863:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.182868:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.182874:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.182879:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.182884:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.182890:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.182895:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.182913:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.182919:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183325:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183337:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183345:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183352:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183361:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183370:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183375:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183381:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183386:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183391:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183760:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183772:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183776:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183782:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183789:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183799:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183809:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183817:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183826:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183833:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183849:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183856:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183862:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183868:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183874:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183880:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183885:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183891:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183896:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183901:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183906:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183911:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183916:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183929:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183935:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183943:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183958:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183964:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183970:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183979:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183985:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183991:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.183997:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.184004:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.184011:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.184016:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.184021:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.184026:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.184033:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.184040:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:3.0:1787365320.186743:0:6683:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_000: service thread [ffff9f27a0286200:6683] 0 exiting: rc = 1 00000100:00100000:3.0:1787365320.186866:0:6684:0:(service.c:3183:ptlrpc_main()) ll_ost_create00_001: service thread [ffff9f27a0286000:6684] 1 exiting: rc = 0 00000100:00100000:1.0:1787365320.187490:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187501:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187508:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187515:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187520:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187527:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187533:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187539:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187545:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187551:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187557:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187563:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187569:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187574:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187579:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187585:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187591:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187596:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187617:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187650:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187657:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187663:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187668:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187674:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187688:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187694:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187700:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187706:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187713:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187719:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187725:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187731:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187737:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187743:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187748:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187753:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187759:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187765:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187770:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187775:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187781:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187786:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187792:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187797:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187803:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187808:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187813:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187818:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187823:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187828:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187833:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187839:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187844:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187858:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187864:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187869:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187875:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187880:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187886:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187891:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187896:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187902:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187907:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.187912:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.199929:0:6688:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_002: service thread [ffff9f27b6493600:6688] 2 exiting: rc = 0 00000100:00100000:1.0:1787365320.202597:0:6686:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_000: service thread [ffff9f27b66e1600:6686] 0 exiting: rc = 1 00000100:00100000:1.0:1787365320.202934:0:6687:0:(service.c:3183:ptlrpc_main()) ll_ost_io00_001: service thread [ffff9f27b66e1400:6687] 1 exiting: rc = 0 00000100:00100000:1.0:1787365320.203029:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.203039:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.203046:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.203053:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.203059:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.203065:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.203084:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.203092:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.203099:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.203105:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.203112:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.203119:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.203126:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.203133:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.203139:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.203154:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.203161:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206700:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206732:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206740:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206762:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206769:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206776:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206784:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206790:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206796:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206802:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206807:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206813:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206818:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206824:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206830:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206836:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206842:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206847:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206853:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206860:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206866:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206872:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206897:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206904:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206909:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206916:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206922:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206928:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206934:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.206941:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.207798:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.207814:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.207820:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.207826:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.207832:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.207838:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.207844:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.207851:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.207875:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.207881:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.207887:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.207894:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.207899:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.207906:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.207912:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.207920:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:1.0:1787365320.207927:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365320.235008:0:6689:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_000: service thread [ffff9f27b6492a00:6689] 0 exiting: rc = 1 00000100:00100000:3.0:1787365320.236960:0:6690:0:(service.c:3183:ptlrpc_main()) ll_ost_seq00_001: service thread [ffff9f27b6492c00:6690] 1 exiting: rc = 0 00000100:00100000:0.0:1787365320.237207:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237217:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237224:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237230:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237236:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237242:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237249:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237254:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237260:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237266:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237273:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237279:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237285:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237290:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237297:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237302:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237308:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237314:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237319:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237324:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237329:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237334:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237340:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237346:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237351:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237357:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237400:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237408:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237414:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237419:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237423:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237428:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237433:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237459:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237465:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237469:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237475:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237480:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237485:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237490:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237495:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237501:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237507:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237514:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237520:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237525:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237531:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237539:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237547:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237552:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237559:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237565:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237571:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237576:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237582:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237588:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237594:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237601:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237607:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237613:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237619:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237909:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237917:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.237923:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:2.0:1787365320.239035:0:6691:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_000: service thread [ffff9f27878a8200:6691] 0 exiting: rc = 1 00000100:00100000:2.0:1787365320.239169:0:6692:0:(service.c:3183:ptlrpc_main()) ll_ost_out00_001: service thread [ffff9f27b6492800:6692] 1 exiting: rc = 0 00000100:00100000:0.0:1787365320.242882:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.242898:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.242905:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.242912:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.242934:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.242967:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.242976:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.242983:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.242990:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.242996:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243008:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243014:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243021:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243028:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243035:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243042:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243049:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243070:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243230:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243237:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243244:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243251:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243260:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243266:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243340:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243350:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243358:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243364:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243371:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243394:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243403:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243409:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243416:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243422:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243429:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243435:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243442:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243448:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243456:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243472:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243478:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243501:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243508:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243518:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243527:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243534:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243541:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243546:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243555:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243562:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243568:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243575:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243582:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243604:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243613:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243619:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243780:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243791:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243801:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243808:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243813:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243820:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243828:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000100:00100000:0.0:1787365320.243836:0:13312:0:(events.c:340:request_in_callback()) peer: 0-0@<0:0> (source: 0-0@<0:0>) 00000020:02000400:0.0:1787365320.258970:0:13312:0:(tgt_mount.c:2181:server_put_super()) server umount lustre-OST0001 complete 00000001:02000400:0.0:1787365339.607277:0:13929:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing load_modules_local 00000020:01000004:3.0:1787365348.945380:0:14390:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:3.0:1787365348.945386:0:14390:0:(obd_mount.c:926:lmd_print()) device: lustre-mdt1/mdt1 00000080:01200004:3.0:1787365348.945502:0:14390:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f27b63ba000 00000020:01000004:3.0:1787365348.945519:0:14390:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-MDT0000, type=osd-zfs, lsifl=200005, mountfl=0 00000020:01000004:3.0:1787365348.945528:0:14390:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-osd (typ=osd-zfs) 00000020:00000080:3.0:1787365348.945542:0:14390:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-osd (ffff9f27b6ed8000) 00000020:00000080:3.0:1787365348.945555:0:14390:0:(obd_config.c:720:class_attach_name()) OBD: dev 0 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787365348.977963:0:14390:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787365348.983623:0:14390:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x11:0x0] (8/32) 00100000:10000000:2.0:1787365348.984292:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-client under 517: rc = 0 00100000:10000000:2.0:1787365348.984432:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0000 under 517: rc = 0 00100000:10000000:2.0:1787365348.984540:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled params under 517: rc = 0 00100000:10000000:2.0:1787365348.984745:0:14390:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787365348.984805:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled nodemap under 517: rc = 0 00100000:10000000:2.0:1787365348.986592:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-MDT0000 under 517: rc = 0 00100000:10000000:2.0:1787365348.986745:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre-OST0001 under 517: rc = 0 00100000:10000000:2.0:1787365348.987146:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lustre under 519: rc = 0 00100000:10000000:2.0:1787365348.988356:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled dt-0x0 under 658: rc = 0 00100000:10000000:2.0:1787365348.988455:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled md-0x0 under 658: rc = 0 00100000:10000000:2.0:1787365348.989111:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000-MDT0000 under 663: rc = 0 00100000:10000000:2.0:1787365348.989372:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 663: rc = 0 00100000:10000000:2.0:1787365348.989684:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000-MDT0000 under 663: rc = 0 00100000:10000000:2.0:1787365348.990062:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000-MDT0000 under 663: rc = 0 00100000:10000000:2.0:1787365348.990303:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 663: rc = 0 00100000:10000000:2.0:1787365348.990572:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 663: rc = 0 00100000:10000000:2.0:1787365348.990841:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000-MDT0000 under 663: rc = 0 00100000:10000000:2.0:1787365348.991249:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 663: rc = 0 00100000:10000000:2.0:1787365348.991505:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 663: rc = 0 00100000:10000000:2.0:1787365348.991835:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000-MDT0000 under 663: rc = 0 00100000:10000000:2.0:1787365348.992194:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000-MDT0000 under 663: rc = 0 00100000:10000000:2.0:1787365348.992473:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 663: rc = 0 00100000:10000000:2.0:1787365348.993074:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_14 under 674: rc = 0 00100000:10000000:2.0:1787365348.993342:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_04 under 674: rc = 0 00100000:10000000:2.0:1787365348.993591:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_07 under 674: rc = 0 00100000:10000000:2.0:1787365348.994460:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_00 under 674: rc = 0 00100000:10000000:2.0:1787365348.994869:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_03 under 674: rc = 0 00100000:10000000:2.0:1787365348.995191:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_09 under 674: rc = 0 00100000:10000000:2.0:1787365348.995432:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_13 under 674: rc = 0 00100000:10000000:2.0:1787365348.996003:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_10 under 674: rc = 0 00100000:10000000:2.0:1787365348.996256:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_14 under 674: rc = 0 00100000:10000000:2.0:1787365348.996523:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_07 under 674: rc = 0 00100000:10000000:3.0:1787365348.998566:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_04 under 674: rc = 0 00100000:10000000:3.0:1787365348.999423:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_03 under 674: rc = 0 00100000:10000000:3.0:1787365349.000243:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_09 under 674: rc = 0 00100000:10000000:3.0:1787365349.000719:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_00 under 674: rc = 0 00100000:10000000:3.0:1787365349.001192:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_10 under 674: rc = 0 00100000:10000000:3.0:1787365349.001432:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_13 under 674: rc = 0 00100000:10000000:3.0:1787365349.002374:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_12 under 674: rc = 0 00100000:10000000:3.0:1787365349.002614:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_11 under 674: rc = 0 00100000:10000000:3.0:1787365349.003524:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_01 under 674: rc = 0 00100000:10000000:3.0:1787365349.003981:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_08 under 674: rc = 0 00100000:10000000:3.0:1787365349.004210:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_02 under 674: rc = 0 00100000:10000000:3.0:1787365349.004461:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_05 under 674: rc = 0 00100000:10000000:3.0:1787365349.004840:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_06 under 674: rc = 0 00100000:10000000:3.0:1787365349.005180:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_15 under 674: rc = 0 00100000:10000000:3.0:1787365349.005418:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_11 under 674: rc = 0 00100000:10000000:3.0:1787365349.006526:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_12 under 674: rc = 0 00100000:10000000:3.0:1787365349.008223:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_08 under 674: rc = 0 00100000:10000000:3.0:1787365349.008494:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_02 under 674: rc = 0 00100000:10000000:3.0:1787365349.009078:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_01 under 674: rc = 0 00100000:10000000:3.0:1787365349.009992:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_06 under 674: rc = 0 00100000:10000000:3.0:1787365349.010456:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_namespace_05 under 674: rc = 0 00100000:10000000:3.0:1787365349.011087:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled lfsck_layout_15 under 674: rc = 0 00100000:10000000:3.0:1787365349.012295:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled [0x200000400:0x1:0x0] under 562: rc = 0 00100000:10000000:3.0:1787365349.013064:0:14390:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x20000:0x0] (8/32) 00100000:10000000:3.0:1787365349.013300:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x20000 under 554: rc = 0 00100000:10000000:3.0:1787365349.013501:0:14390:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1020000:0x0] (8/32) 00100000:10000000:3.0:1787365349.013579:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1020000 under 554: rc = 0 00100000:10000000:3.0:1787365349.014350:0:14390:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2020000:0x0] (8/32) 00100000:10000000:3.0:1787365349.014424:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2020000 under 554: rc = 0 00100000:10000000:3.0:1787365349.017503:0:14390:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x10000:0x0] (8/32) 00100000:10000000:3.0:1787365349.017596:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x10000 under 659: rc = 0 00100000:10000000:3.0:1787365349.018243:0:14390:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x1010000:0x0] (8/32) 00100000:10000000:3.0:1787365349.018320:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x1010000 under 659: rc = 0 00100000:10000000:3.0:1787365349.018513:0:14390:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-MDT0000: registered index [0x200000006:0x2010000:0x0] (8/32) 00100000:10000000:3.0:1787365349.018578:0:14390:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-MDT0000: initial OI scrub handled 0x2010000 under 659: rc = 0 00000020:00000080:3.0:1787365349.019040:0:14390:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-osd (uuid lustre-MDT0000-osd_UUID) 00080000:01000000:3.0:1787365349.019049:0:14390:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787365349.019060:0:14390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x872d29295eb47c77 00000020:01000004:3.0:1787365349.019069:0:14390:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-MDT0000 on device lustre-mdt1/mdt1 00000020:01000000:3.0:1787365349.019074:0:14390:0:(tgt_mount.c:219:server_start_mgs()) Start MGS service MGS 00000020:01000004:3.0:1787365349.019080:0:14390:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f27b63ba000 from MGS 00000020:01000004:3.0:1787365349.019084:0:14390:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGS (typ=mgs) 00000020:00000080:3.0:1787365349.019094:0:14390:0:(genops.c:413:class_newdev()) Allocate new device MGS (ffff9f27b6edb370) 00000020:00000080:3.0:1787365349.019104:0:14390:0:(obd_config.c:720:class_attach_name()) OBD: dev 1 attached type mgs with refcount 2 00000020:01000004:3.0:1787365349.019166:0:14390:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f27b63ba000 from MGS, refs=2 00080000:01000000:3.0:1787365349.019171:0:14390:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:3.0:1787365349.019176:0:14390:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x872d29295eb47c85 00000100:00100000:3.0:1787365349.019267:0:14390:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/1 left), rc = 0 00000100:00100000:3.0:1787365349.019422:0:14390:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 0 min 2 max 56 00000100:00100000:3.0:1787365349.019428:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_000' 00000100:00100000:3.0:1787365349.020770:0:14390:0:(service.c:3462:ptlrpc_start_thread()) ldlm_cbd[0] started 1 min 2 max 56 00000100:00100000:3.0:1787365349.020780:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cb00_001' 00000100:00100000:3.0:1787365349.028224:0:14390:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_canceld: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:3.0:1787365349.028410:0:14390:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 0 min 3 max 56 00000100:00100000:3.0:1787365349.028416:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_000' 00000100:00100000:3.0:1787365349.036840:0:14390:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 1 min 3 max 56 00000100:00100000:3.0:1787365349.036857:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_001' 00000100:00100000:2.0:1787365349.037561:0:14390:0:(service.c:3462:ptlrpc_start_thread()) ldlm_canceld[0] started 2 min 3 max 56 00000100:00100000:2.0:1787365349.037571:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'ldlm_cn00_002' 00010000:00010000:3.0:1787365349.038371:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365349.038374:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365349.038376:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365349.049910:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365349.049928:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365349.049931:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365349.050511:0:14390:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGS-0 is initialized 00010000:00010000:3.0:1787365349.061802:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:01000000:0.0:1787365349.074947:0:14390:0:(llog_obd.c:197:llog_setup()) obd MGS ctxt 0 is initialized 20000000:01000000:0.0:1787365349.074965:0:14390:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping . 20000000:01000000:0.0:1787365349.074968:0:14390:0:(mgs_llog.c:152:class_dentry_readdir()) Not in white list, skipping .. 10000000:01000000:1.0:1787365349.084253:0:14399:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x2 (params) 20000000:01000000:1.0:1787365349.084437:0:14390:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 2 20000000:01000000:1.0:1787365349.084575:0:14390:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:1.0:1787365349.085620:0:14390:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 00000100:00100000:1.0:1787365349.087587:0:14390:0:(service.c:155:ptlrpc_grow_req_bufs()) mgs: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787365349.087797:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 0 min 3 max 32 00000100:00100000:1.0:1787365349.087804:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0000' 00000100:00100000:2.0:1787365349.089690:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 1 min 3 max 32 00000100:00100000:2.0:1787365349.089701:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0001' 00000100:00100000:3.0:1787365349.090201:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mgs[-1] started 2 min 3 max 32 00000100:00100000:3.0:1787365349.090208:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_mgs_0002' 00000020:00000080:3.0:1787365349.092784:0:14390:0:(obd_config.c:826:class_setup()) finished setup of obd MGS (uuid MGS) 00000020:01000004:3.0:1787365349.092806:0:14390:0:(obd_mount.c:411:lustre_start_mgc()) Start MGC 'MGC192.168.203.113@tcp' 00000020:01000004:3.0:1787365349.092808:0:14390:0:(obd_mount.c:420:lustre_start_mgc()) mgs NIDs (null). 00000020:01000004:3.0:1787365349.092838:0:14390:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MGC192.168.203.113@tcp (typ=mgc) 00000020:00000080:3.0:1787365349.092851:0:14390:0:(genops.c:413:class_newdev()) Allocate new device MGC192.168.203.113@tcp (ffff9f27b6edcd28) 00000020:00000080:3.0:1787365349.092865:0:14390:0:(obd_config.c:720:class_attach_name()) OBD: dev 2 attached type mgc with refcount 2 00010000:00080000:3.0:1787365349.092945:0:14390:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f27b63b9000@MGC192.168.203.113@tcp: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1787365349.093098:0:14390:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-MGC192.168.203.113@tcp-0 is initialized 00000040:01000000:3.0:1787365349.093103:0:14390:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 1 is initialized 00000100:00080000:0.0:1787365349.093322:0:14404:0:(pinger.c:466:ping_evictor_main()) Starting Ping Evictor 10000000:01000000:3.0:1787365349.097873:0:14405:0:(mgc_request.c:631:mgc_requeue_thread()) Starting requeue thread 00000020:00000080:1.0:1787365349.097987:0:14390:0:(obd_config.c:826:class_setup()) finished setup of obd MGC192.168.203.113@tcp (uuid f26df4b8-3dbe-45e2-8af9-ef09f94ac229) 00000020:00000080:1.0:1787365349.098011:0:14390:0:(genops.c:1385:class_connect()) connect: client f26df4b8-3dbe-45e2-8af9-ef09f94ac229, cookie 0x872d29295eb47c93 00000100:00080000:1.0:1787365349.098023:0:14390:0:(import.c:510:import_select_connection()) MGC192.168.203.113@tcp: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787365349.098030:0:14390:0:(import.c:624:import_select_connection()) MGC192.168.203.113@tcp: import ffff9f27b63b9000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1787365349.098063:0:14390:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f27bb40b480 x1874188024503552/t0(0) o250->MGC192.168.203.113@tcp@0@lo:26/25 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787365349.098084:0:14390:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import f26df4b8-3dbe-45e2-8af9-ef09f94ac229->MGS 00000020:01000004:1.0:1787365349.098103:0:14390:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-MDT0000 00000020:01000004:1.0:1787365349.098108:0:14390:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD MDS (typ=mds) 00000020:00000080:1.0:1787365349.098120:0:14390:0:(genops.c:413:class_newdev()) Allocate new device MDS (ffff9f27872b99b8) 00000020:00000080:1.0:1787365349.098141:0:14390:0:(obd_config.c:720:class_attach_name()) OBD: dev 3 attached type mds with refcount 2 00000100:00100000:0.0:1787365349.108128:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb40b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3309:1874188024503552:0@lo:250:mount.lustre.0 00000100:00100000:0.0:1787365349.108209:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365349.115912:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024503552 00000100:00100000:1.0:1787365349.115927:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024503552 00000100:00100000:1.0:1787365349.115965:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787365349.115974:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:0+-99:3309:x1874188024503552:12345-0@lo:250:mount.lustre.0 00010000:00080000:1.0:1787365349.115999:0:14401:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from f26df4b8-3dbe-45e2-8af9-ef09f94ac229@0@lo t0 exp 0000000000000000 cur 466 last 0 00000020:00000080:1.0:1787365349.116035:0:14401:0:(genops.c:1385:class_connect()) connect: client f26df4b8-3dbe-45e2-8af9-ef09f94ac229, cookie 0x872d29295eb47ca1 00000100:00080000:1.0:1787365349.116162:0:14401:0:(import.c:65:import_set_state_nolock()) ffff9f27833e9800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787365349.116240:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+5:3309:x1874188024503552:12345-0@lo:250:mount.lustre.0 Request processed in 267us (8030us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365349.116248:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787365349.119196:0:3309:0:(client.c:3125:ptlrpc_free_committed()) MGC192.168.203.113@tcp: committing for last_committed 0 gen 1 00000100:00080000:0.0:1787365349.119211:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) MGC192.168.203.113@tcp: connect to target with instance 0 00000100:00080000:0.0:1787365349.119220:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) MGC192.168.203.113@tcp: Resetting ns_connect_flags to server flags: 0xa000011001002060 10000000:01000000:0.0:1787365349.119225:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808005 00000100:00080000:0.0:1787365349.119230:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9f27b63b9000 MGS: changing import state from CONNECTING to FULL 10000000:01000000:0.0:1787365349.119233:0:3309:0:(mgc_request.c:1168:mgc_import_event()) import event 0x808004 00000100:00080000:0.0:1787365349.119249:0:3309:0:(pinger.c:186:ptlrpc_pinger_ir_up()) IR up 00000100:00100000:0.0:1787365349.119258:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb40b480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3309:1874188024503552:0@lo:250:mount.lustre.0 00000100:00100000:1.0:1787365349.122119:0:14390:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt: allocate 64 new 262144-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787365349.122318:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 0 min 3 max 116 00000100:00100000:1.0:1787365349.122324:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_000' 00000100:00100000:1.0:1787365349.124430:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 1 min 3 max 116 00000100:00100000:1.0:1787365349.124444:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_001' 00000100:00100000:1.0:1787365349.125075:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 2 min 3 max 116 00000100:00100000:1.0:1787365349.125082:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_002' 00000100:00100000:0.0:1787365349.125699:0:14390:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_readpage: allocate 64 new 8192-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787365349.125877:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 0 min 2 max 80 00000100:00100000:0.0:1787365349.125882:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_000' 00000100:00100000:1.0:1787365349.126370:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_readpage[0] started 1 min 2 max 80 00000100:00100000:1.0:1787365349.126376:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_rdpg00_001' 00000100:00100000:0.0:1787365349.186181:0:14390:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787365349.186409:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 0 min 2 max 116 00000100:00100000:0.0:1787365349.186415:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_000' 00000100:00100000:0.0:1787365349.188422:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_out[0] started 1 min 2 max 116 00000100:00100000:0.0:1787365349.188433:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_out00_001' 00000100:00100000:0.0:1787365349.189109:0:14390:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqs: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787365349.189414:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787365349.189419:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0000' 00000100:00100000:0.0:1787365349.191331:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqs[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787365349.191348:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqs_0001' 00000100:00100000:0.0:1787365349.192308:0:14390:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_seqm: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787365349.192601:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787365349.192607:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0000' 00000100:00100000:0.0:1787365349.194092:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_seqm[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787365349.194101:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_seqm_0001' 00000100:00100000:0.0:1787365349.202875:0:14390:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_fld: allocate 64 new 4096-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787365349.203058:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 0 min 2 max 256 00000100:00100000:0.0:1787365349.203064:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0000' 00000100:00100000:0.0:1787365349.205035:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_fld[-1] started 1 min 2 max 256 00000100:00100000:0.0:1787365349.205047:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_fld_0001' 00000100:00100000:1.0:1787365349.230431:0:14390:0:(service.c:155:ptlrpc_grow_req_bufs()) mdt_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787365349.231944:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787365349.231954:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_000' 00000100:00100000:1.0:1787365349.238259:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 1 min 3 max 116 00000100:00100000:1.0:1787365349.238280:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_001' 00000100:00100000:0.0:1787365349.247109:0:14390:0:(service.c:3462:ptlrpc_start_thread()) mdt_io[0] started 2 min 3 max 116 00000100:00100000:0.0:1787365349.247131:0:14390:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt_io00_002' 00000020:00000080:0.0:1787365349.248115:0:14390:0:(obd_config.c:826:class_setup()) finished setup of obd MDS (uuid MDS_uuid) 00000020:01000004:0.0:1787365349.248137:0:14390:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-mdt1/mdt1 10000000:01000000:0.0:1787365349.248143:0:14390:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-MDT0000-osd for locked: rc = 0 00000040:01000000:0.0:1787365349.248268:0:14390:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:0.0:1787365349.248302:0:14390:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-MDT0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20005 00000020:01000004:0.0:1787365349.248307:0:14390:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:0.0:1787365349.248308:0:14390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787365349.248310:0:14390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787365349.248311:0:14390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787365349.248313:0:14390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787365349.248314:0:14390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787365349.248315:0:14390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787365349.248317:0:14390:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787365349.248319:0:14390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787365349.248320:0:14390:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787365349.248322:0:14390:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x10020005 00000020:01000004:0.0:1787365349.248325:0:14390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:0.0:1787365349.248326:0:14390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:0.0:1787365349.248327:0:14390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:0.0:1787365349.248328:0:14390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:0.0:1787365349.248329:0:14390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:0.0:1787365349.248330:0:14390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:0.0:1787365349.248331:0:14390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:0.0:1787365349.248332:0:14390:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:0.0:1787365349.248333:0:14390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:0.0:1787365349.248334:0:14390:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:0.0:1787365349.248360:0:14390:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:0.0:1787365349.248378:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2798098000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024503680:0@lo:253:mount.lustre.0 00000100:00100000:0.0:1787365349.248445:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365349.248507:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27a024bb40 going to sleep for 11 seconds 00000100:00100000:3.0:1787365349.248607:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024503680 00000100:00100000:3.0:1787365349.248613:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024503680 00000100:00100000:3.0:1787365349.248681:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:3.0:1787365349.248691:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+5:14390:x1874188024503680:12345-0@lo:253:mount.lustre.0 20000000:01000000:3.0:1787365349.248733:0:14403:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:3.0:1787365349.248736:0:14403:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:3.0:1787365349.248738:0:14403:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-MDT0000 is running on 0@lo 10000000:01000000:3.0:1787365349.249103:0:14424:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 20000000:01000000:0.0:1787365349.249432:0:14403:0:(mgs_nids.c:666:mgs_nidtbl_init_fs()) IR: current version is 5 20000000:01000000:3.0:1787365349.250466:0:14425:0:(mgs_llog.c:340:mgs_fsdb_handler()) MDT index is 0 20000000:01000000:3.0:1787365349.250472:0:14425:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0000_UUID is 0 (0) 20000000:01000000:3.0:1787365349.250475:0:14425:0:(mgs_llog.c:324:mgs_fsdb_handler()) OST index for lustre-OST0001_UUID is 1 (1) 00000040:00080000:3.0:1787365349.250520:0:14425:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 20000000:01000000:0.0:1787365349.250896:0:14403:0:(mgs_llog.c:684:mgs_find_or_make_fsdb_nolock()) Created new db: rc = 0 20000000:01000000:0.0:1787365349.250905:0:14403:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 00000100:00100000:0.0:1787365349.264461:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+5:14390:x1874188024503680:12345-0@lo:253:mount.lustre.0 Request processed in 15763us (16007us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365349.264504:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787365349.264582:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2798098000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024503680:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787365349.264598:0:14390:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787365349.264602:0:14390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787365349.264603:0:14390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787365349.264605:0:14390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787365349.264607:0:14390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787365349.264608:0:14390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787365349.264609:0:14390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787365349.264611:0:14390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787365349.264612:0:14390:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787365349.264614:0:14390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787365349.264615:0:14390:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:1.0:1787365349.264859:0:14390:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f27b63ba000 from lustre-MDT0000 10000000:01000000:1.0:1787365349.264884:0:14390:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-MDT0000 from 0 10000000:01000000:1.0:1787365349.264891:0:14390:0:(mgc_request.c:329:config_log_add()) add config log lustre-MDT0000-0000000000000000 10000000:01000000:1.0:1787365349.264905:0:14390:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-sptlrpc-ffff9f27b6edcd28 10000000:01000000:1.0:1787365349.264910:0:14390:0:(mgc_request.c:68:mgc_name2resid()) log lustre-sptlrpc to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787365349.264917:0:14390:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-sptlrpc-ffff9f27b6edcd28 from 1 10000000:01000000:1.0:1787365349.264920:0:14390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-sptlrpc (res 0x65727473756c) 00010000:00010000:1.0:1787365349.264957:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2798115800/0x872d29295eb47ca8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.264968:0:14390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2798115800/0x872d29295eb47ca8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.264977:0:14390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2798115800/0x872d29295eb47ca8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365349.264996:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb408000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024503808:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787365349.265032:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365349.265070:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27867adcc0 going to sleep for 11 seconds 00000100:00100000:2.0:1787365349.265137:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024503808 00000100:00100000:2.0:1787365349.265143:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024503808 00000100:00100000:2.0:1787365349.265185:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787365349.265194:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+5:14390:x1874188024503808:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787365349.265215:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365349.265230:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27bb708000/0x872d29295eb47caf lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb47ca8 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365349.265251:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27bb708000/0x872d29295eb47caf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb47ca8 expref: 6 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365349.265261:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27bb708000/0x872d29295eb47caf lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47ca8 expref: 6 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365349.265269:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb708000, rc 0) 00000100:00100000:2.0:1787365349.265312:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+6:14390:x1874188024503808:12345-0@lo:101:mount.lustre.0 Request processed in 119us (279us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365349.265318:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787365349.265524:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb408000 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024503808:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787365349.265537:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2798115800/0x872d29295eb47ca8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47caf expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365349.265558:0:14390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2798115800/0x872d29295eb47ca8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb47caf expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365349.265602:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024503936:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787365349.265660:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365349.265678:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878a5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787365349.265725:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024503936 00000100:00100000:2.0:1787365349.265729:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024503936 00000100:00100000:2.0:1787365349.265770:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787365349.265777:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+6:14390:x1874188024503936:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787365349.265989:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+6:14390:x1874188024503936:12345-0@lo:501:mount.lustre.0 Request processed in 212us (327us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787365349.265996:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787365349.266143:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024503936:0@lo:501:mount.lustre.0 10000000:01000000:3.0:1787365349.266167:0:14390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-sptlrpc' failed (-2). 00010000:00010000:3.0:1787365349.266182:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2798115800/0x872d29295eb47ca8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47caf expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365349.266189:0:14390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2798115800/0x872d29295eb47ca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47caf expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365349.266197:0:14390:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f27b63ba000 10000000:01000000:3.0:1787365349.266210:0:14390:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:3.0:1787365349.266214:0:14390:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-barrier-ffff9f27b63ba000 10000000:01000000:3.0:1787365349.266217:0:14390:0:(mgc_request.c:68:mgc_name2resid()) log lustre-barrier to resid 0x65727473756c/0x5 (lustre) 10000000:01000000:3.0:1787365349.266219:0:14390:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-barrier-ffff9f27b63ba000 from 1 10000000:01000000:3.0:1787365349.266221:0:14390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-barrier (res 0x65727473756c) 00010000:00010000:3.0:1787365349.266239:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2788f45800/0x872d29295eb47cb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365349.266246:0:14390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2788f45800/0x872d29295eb47cb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365349.266254:0:14390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2788f45800/0x872d29295eb47cb6 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365349.266273:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024504064:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787365349.266299:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365349.266310:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878a5b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787365349.266443:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024504064 00000100:00100000:2.0:1787365349.266448:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024504064 00000100:00100000:2.0:1787365349.266479:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787365349.266495:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+6:14390:x1874188024504064:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787365349.266502:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365349.266513:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27bb709c00/0x872d29295eb47cbd lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb47cb6 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365349.266527:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27bb709c00/0x872d29295eb47cbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb47cb6 expref: 7 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365349.266535:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27bb709c00/0x872d29295eb47cbd lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47cb6 expref: 7 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365349.266542:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb709c00, rc 0) 00000100:00100000:2.0:1787365349.266569:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+7:14390:x1874188024504064:12345-0@lo:101:mount.lustre.0 Request processed in 75us (270us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365349.266575:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787365349.266672:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024504064:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787365349.266682:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2788f45800/0x872d29295eb47cb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47cbd expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365349.266689:0:14390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2788f45800/0x872d29295eb47cb6 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb47cbd expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365349.266701:0:14390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-barrier' succeeded (0). 00010000:00010000:3.0:1787365349.266707:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2788f45800/0x872d29295eb47cb6 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47cbd expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365349.266712:0:14390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2788f45800/0x872d29295eb47cb6 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x5:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47cbd expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365349.266717:0:14390:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-MDT0000-0000000000000000 10000000:01000000:3.0:1787365349.266721:0:14390:0:(mgc_request.c:68:mgc_name2resid()) log lustre-MDT0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:3.0:1787365349.266724:0:14390:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-mdtir-ffff9f27b63ba000 10000000:01000000:3.0:1787365349.266727:0:14390:0:(mgc_request.c:68:mgc_name2resid()) log lustre-mdtir to resid 0x65727473756c/0x2 (lustre) 10000000:01000000:3.0:1787365349.266729:0:14390:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-MDT0000-0000000000000000 from 1 10000000:01000000:3.0:1787365349.266731:0:14390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-MDT0000 (res 0x65727473756c) 00010000:00010000:3.0:1787365349.266756:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2788f44200/0x872d29295eb47cc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365349.266763:0:14390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2788f44200/0x872d29295eb47cc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365349.266777:0:14390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2788f44200/0x872d29295eb47cc4 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365349.266789:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024504192:0@lo:101:mount.lustre.0 00000100:00100000:3.0:1787365349.266812:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365349.266829:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878a5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787365349.266936:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024504192 00000100:00100000:1.0:1787365349.266941:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024504192 00000100:00100000:1.0:1787365349.266968:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787365349.266976:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+7:14390:x1874188024504192:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787365349.266982:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365349.266990:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2798115400/0x872d29295eb47ccb lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb47cc4 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.267002:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2798115400/0x872d29295eb47ccb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb47cc4 expref: 8 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.267010:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2798115400/0x872d29295eb47ccb lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47cc4 expref: 8 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.267026:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115400, rc 0) 00000100:00100000:1.0:1787365349.267053:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+8:14390:x1874188024504192:12345-0@lo:101:mount.lustre.0 Request processed in 78us (240us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365349.267059:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787365349.267415:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024504192:0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787365349.267425:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2788f44200/0x872d29295eb47cc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47ccb expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365349.267433:0:14390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2788f44200/0x872d29295eb47cc4 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb47ccb expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365349.267472:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024504320:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787365349.267509:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365349.267530:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878a5b40 going to sleep for 11 seconds 00000100:00100000:1.0:1787365349.267574:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024504320 00000100:00100000:1.0:1787365349.267579:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024504320 00000100:00100000:1.0:1787365349.267606:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787365349.267611:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+8:14390:x1874188024504320:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787365349.270132:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+9:14390:x1874188024504320:12345-0@lo:501:mount.lustre.0 Request processed in 2512us (2614us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365349.270145:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787365349.272812:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf93100 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024504320:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787365349.272878:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024504448:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787365349.272958:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365349.272997:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27867ad3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365349.273191:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024504448 00000100:00100000:3.0:1787365349.273198:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024504448 00000100:00100000:3.0:1787365349.273261:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:3.0:1787365349.273270:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+9:14390:x1874188024504448:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787365349.273671:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+9:14390:x1874188024504448:12345-0@lo:503:mount.lustre.0 Request processed in 402us (712us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365349.273681:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787365349.274159:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024504448:0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787365349.274586:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbadbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14426:1874188024504576:0@lo:502:llog_process_th.0 00000100:00100000:2.0:1787365349.274661:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365349.274689:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bb9e3540 going to sleep for 11 seconds 00000100:00100000:3.0:1787365349.275011:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024504576 00000100:00100000:3.0:1787365349.275016:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024504576 00000100:00100000:3.0:1787365349.275056:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:3.0:1787365349.275064:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+9:14426:x1874188024504576:12345-0@lo:502:llog_process_th.0 00000100:00100000:3.0:1787365349.275364:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+9:14426:x1874188024504576:12345-0@lo:502:llog_process_th.0 Request processed in 300us (702us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365349.275372:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787365349.275516:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbadbb80 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14426:1874188024504576:0@lo:502:llog_process_th.0 00000020:01000000:0.0:1787365349.275540:0:14426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787365349.275552:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365349.275554:0:14426:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787365349.275559:0:14426:0:(obd_config.c:1967:class_config_llog_handler()) For 2.x interoperability, rename obd type from lov to lod (lustre-MDT0000) 00000020:00000080:0.0:1787365349.275562:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787365349.275575:0:14426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-mdtlov (ffff9f27bbec19b8) 00000020:00000080:0.0:1787365349.275591:0:14426:0:(obd_config.c:720:class_attach_name()) OBD: dev 4 attached type lod with refcount 2 00000020:00000080:0.0:1787365349.275597:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00080000:01000000:0.0:1787365349.275699:0:14426:0:(osd_handler.c:1564:osd_obd_connect()) connect #2 00000020:00000080:0.0:1787365349.275707:0:14426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x872d29295eb47cd9 00000020:00000080:0.0:1787365349.275920:0:14426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-mdtlov (uuid lustre-MDT0000-mdtlov_UUID) 00000020:01000000:0.0:1787365349.275925:0:14426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787365349.275929:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365349.275931:0:14426:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) lustre-MDT0000-m lov setup 00000020:01000000:0.0:1787365349.275934:0:14426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787365349.275937:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365349.275938:0:14426:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) lustre-MDT0000 add mdt 00000020:00000080:0.0:1787365349.275941:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787365349.275948:0:14426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000 (ffff9f27bbec4d28) 00000020:00000080:0.0:1787365349.275957:0:14426:0:(obd_config.c:720:class_attach_name()) OBD: dev 5 attached type mdt with refcount 2 00000020:00000080:0.0:1787365349.275961:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf007 00000020:00000080:0.0:1787365349.275963:0:14426:0:(obd_config.c:1516:class_process_config()) mountopt: profile lustre-MDT0000 osc lustre-MDT0000-mdtlov mdc (null) 00000020:01000000:0.0:1787365349.275965:0:14426:0:(obd_config.c:1149:class_add_profile()) Add profile lustre-MDT0000 00000020:00000080:0.0:1787365349.275970:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787365349.276016:0:14426:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f27b63ba000 from lustre-MDT0000, refs=3 00000020:00000080:0.0:1787365349.276030:0:14426:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDD0000 (ffff9f27bbec3370) 00000020:00000080:0.0:1787365349.276038:0:14426:0:(obd_config.c:720:class_attach_name()) OBD: dev 6 attached type mdd with refcount 2 00000004:01000000:0.0:1787365349.276087:0:14426:0:(lod_dev.c:2291:lod_obd_connect()) connect #0 00000020:00000080:0.0:1787365349.276095:0:14426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x872d29295eb47cee 00000020:00000080:0.0:1787365349.276196:0:14426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDD0000 (uuid lustre-MDD0000_UUID) 00000004:01000000:0.0:1787365349.276314:0:14426:0:(mdd_device.c:1598:mdd_obd_connect()) connect #0 00000020:00000080:0.0:1787365349.276322:0:14426:0:(genops.c:1385:class_connect()) connect: client lustre-MDD0000_UUID, cookie 0x872d29295eb47cf5 00080000:01000000:0.0:1787365349.276328:0:14426:0:(osd_handler.c:1564:osd_obd_connect()) connect #3 00000020:00000080:0.0:1787365349.276335:0:14426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x872d29295eb47cfc 00010000:00010000:2.0:1787365349.394911:0:14426:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-mdt-lustre-MDT0000_UUID-1 is initialized 00000001:00000004:2.0:1787365349.395998:0:14426:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 4294967526 00000001:00080000:0.0:1787365349.400452:0:14426:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000020:00000080:0.0:1787365349.404474:0:14426:0:(genops.c:413:class_newdev()) Allocate new device lustre-QMT0000 (ffff9f27bbec0000) 00000020:00000080:0.0:1787365349.404517:0:14426:0:(obd_config.c:720:class_attach_name()) OBD: dev 7 attached type qmt with refcount 2 00080000:01000000:0.0:1787365349.404601:0:14426:0:(osd_handler.c:1564:osd_obd_connect()) connect #4 00000020:00000080:0.0:1787365349.404608:0:14426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x872d29295eb47d0a 00000020:00000080:0.0:1787365349.407048:0:14426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-QMT0000 (uuid lustre-QMT0000_UUID) 00000020:00000080:0.0:1787365349.421218:0:14426:0:(genops.c:1385:class_connect()) connect: client lustre-QMT0000_UUID, cookie 0x872d29295eb47d11 00000020:00000080:1.0:1787365349.421834:0:14426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000 (uuid lustre-MDT0000_UUID) 00000020:01000000:1.0:1787365349.421854:0:14426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787365349.421861:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365349.421863:0:14426:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) lustre-MDT0000 add mdt 00000020:01000000:1.0:1787365349.421871:0:14426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787365349.421874:0:14426:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #8 00000020:01000000:1.0:1787365349.421876:0:14426:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787365349.421878:0:14426:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787365349.421879:0:14426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787365349.421882:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365349.421883:0:14426:0:(obd_config.c:1563:class_process_config()) marker 8 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787365349.421886:0:14426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787365349.421891:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365349.421892:0:14426:0:(obd_config.c:1563:class_process_config()) marker 10 (0x1) lustre-MDT0000 mdt.identity_upcall 00000020:00000080:1.0:1787365349.421906:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000004:01000000:1.0:1787365349.421943:0:14426:0:(mdt_lproc.c:316:identity_upcall_store()) lustre-MDT0000: identity upcall set to /home/green/git/lustre-release/lustre/utils/l_getidentity 00000020:01000000:1.0:1787365349.421962:0:14426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787365349.421966:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365349.421967:0:14426:0:(obd_config.c:1563:class_process_config()) marker 10 (0x2) lustre-MDT0000 mdt.identity_upcall 00000020:01000000:1.0:1787365349.421970:0:14426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787365349.421973:0:14426:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787365349.421977:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365349.421978:0:14426:0:(obd_config.c:1563:class_process_config()) marker 12 (0x1) lustre-OST0000 add osc 00000020:00000080:1.0:1787365349.421981:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787365349.421986:0:14426:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:1.0:1787365349.422010:0:14426:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787365349.422013:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787365349.422027:0:14426:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osc-MDT0000 (ffff9f27872b8000) 00000020:00000080:1.0:1787365349.422040:0:14426:0:(obd_config.c:720:class_attach_name()) OBD: dev 8 attached type osp with refcount 2 00000020:00000080:1.0:1787365349.422045:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787365349.422092:0:14426:0:(osp_dev.c:1203:osp_init0()) lustre-OST0000-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0000-osc-MDT0000) 00080000:01000000:1.0:1787365349.422098:0:14426:0:(osd_handler.c:1564:osd_obd_connect()) connect #5 00000020:00000080:1.0:1787365349.422103:0:14426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x872d29295eb47d1f 00010000:00080000:1.0:1787365349.422131:0:14426:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f27bb87d800@lustre-OST0000-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1787365349.422561:0:14426:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0000-osc-MDT0000-1 is initialized 00000040:01000000:1.0:1787365349.425419:0:14426:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787365349.425475:0:14426:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0000-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787365349.426461:0:14426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787365349.426526:0:14426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x2:0x0].2, 64 off8320 00000040:00080000:1.0:1787365349.426584:0:14426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xa:0x0].1, 64 off8256 00000040:00080000:1.0:1787365349.429663:0:14430:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:1.0:1787365349.429670:0:14430:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xa:0x0] at index 2 of catalog [0x1:0x2:0x0] 00000020:00000080:0.0:1787365349.430531:0:14426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:0.0:1787365349.430543:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:0.0:1787365349.430587:0:14426:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0000_UUID idx:0 gen:1 00000020:00000080:0.0:1787365349.430604:0:14426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x872d29295eb47d26 00000100:00080000:0.0:1787365349.430615:0:14426:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:0.0:1787365349.430620:0:14426:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f27bb87d800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1787365349.430838:0:14426:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f27bb409880 x1874188024504704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787365349.430960:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024504704:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787365349.431010:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874188024504704 offset 0 length 520: 4 00000100:00080000:1.0:1787365349.431068:0:14426:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID 00000020:01000000:1.0:1787365349.431132:0:14426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787365349.431137:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365349.431139:0:14426:0:(obd_config.c:1563:class_process_config()) marker 12 (0x2) lustre-OST0000 add osc 00000020:01000000:1.0:1787365349.431142:0:14426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:1.0:1787365349.431145:0:14426:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #14 00000020:01000000:1.0:1787365349.431147:0:14426:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787365349.431149:0:14426:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:1.0:1787365349.431150:0:14426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:1.0:1787365349.431153:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365349.431154:0:14426:0:(obd_config.c:1563:class_process_config()) marker 14 (0x6) lustre sys.timeout 00000020:01000000:1.0:1787365349.431157:0:14426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:1.0:1787365349.431161:0:14426:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-mdt1/mdt1 00000020:00000080:1.0:1787365349.431164:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365349.431165:0:14426:0:(obd_config.c:1563:class_process_config()) marker 18 (0x1) lustre-OST0001 add osc 00000020:00000080:1.0:1787365349.431168:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf005 00000020:00000080:1.0:1787365349.431172:0:14426:0:(obd_config.c:1487:class_process_config()) adding mapping from uuid 192.168.203.113@tcp to nid 0x20000c0a8cb71 (192.168.203.113@tcp) 00000020:01000000:1.0:1787365349.431192:0:14426:0:(obd_config.c:1974:class_config_llog_handler()) For 2.x interoperability, rename obd type from osc to osp (lustre-MDT0000) 00000020:00000080:1.0:1787365349.431195:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:1.0:1787365349.431217:0:14426:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osc-MDT0000 (ffff9f27872bb370) 00000020:00000080:1.0:1787365349.431229:0:14426:0:(obd_config.c:720:class_attach_name()) OBD: dev 9 attached type osp with refcount 2 00000020:00000080:1.0:1787365349.431234:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000004:00080000:1.0:1787365349.431286:0:14426:0:(osp_dev.c:1203:osp_init0()) lustre-OST0001-osc-MDT0000: connect to lustre-MDT0000-osd (lustre-OST0001-osc-MDT0000) 00080000:01000000:1.0:1787365349.431292:0:14426:0:(osd_handler.c:1564:osd_obd_connect()) connect #6 00000020:00000080:1.0:1787365349.431297:0:14426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-osd_UUID, cookie 0x872d29295eb47d34 00010000:00080000:1.0:1787365349.431323:0:14426:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f27bbae3800@lustre-OST0001-osc-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1787365349.431529:0:14426:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-OST0001-osc-MDT0000-2 is initialized 00000040:01000000:1.0:1787365349.431737:0:14426:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=64, read=32 00000040:01000000:1.0:1787365349.431757:0:14426:0:(llog_obd.c:197:llog_setup()) obd lustre-OST0001-osc-MDT0000 ctxt 2 is initialized 00000040:00080000:1.0:1787365349.432277:0:14426:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787365349.432341:0:14426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0x5:0x0].2, 64 off8320 00000040:00080000:1.0:1787365349.432417:0:14426:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].1, 64 off8256 00000040:00080000:3.0:1787365349.433160:0:14432:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787365349.433165:0:14432:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xc:0x0] at index 2 of catalog [0x1:0x5:0x0] 00000020:00000080:1.0:1787365349.434106:0:14426:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osc-MDT0000 (uuid lustre-MDT0000-mdtlov_UUID) 00000020:00000080:1.0:1787365349.434119:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00d 00000004:01000000:1.0:1787365349.434158:0:14426:0:(lod_lov.c:128:lod_add_device()) osp:lustre-OST0001_UUID idx:1 gen:1 00000020:00000080:1.0:1787365349.434174:0:14426:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x872d29295eb47d3b 00000100:00080000:1.0:1787365349.434184:0:14426:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787365349.434189:0:14426:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f27bbae3800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1787365349.434342:0:14426:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f27bb40ad80 x1874188024504832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:0.0:1787365349.434397:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb40ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024504832:0@lo:8:llog_process_th.0 00000400:00000100:0.0:1787365349.434447:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874188024504832 offset 0 length 520: 4 00000100:00080000:1.0:1787365349.434504:0:14426:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID 00000020:01000000:1.0:1787365349.434550:0:14426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787365349.434554:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365349.434556:0:14426:0:(obd_config.c:1563:class_process_config()) marker 18 (0x2) lustre-OST0001 add osc 00000020:01000000:1.0:1787365349.434559:0:14426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787365349.434563:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365349.434565:0:14426:0:(obd_config.c:1563:class_process_config()) marker 21 (0x1) lustre sys.timeout 00000020:00000080:1.0:1787365349.434568:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:1.0:1787365349.434570:0:14426:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:1.0:1787365349.434572:0:14426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787365349.434574:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365349.434575:0:14426:0:(obd_config.c:1563:class_process_config()) marker 21 (0x2) lustre sys.timeout 00000020:01000000:1.0:1787365349.434577:0:14426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787365349.434579:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365349.434580:0:14426:0:(obd_config.c:1563:class_process_config()) marker 25 (0x1) lustre sys.jobid_var 00000020:00000080:1.0:1787365349.434584:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000100:00100000:1.0:1787365349.434612:0:14426:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb408000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14426:1874188024504960:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787365349.434686:0:14426:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365349.434717:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024504960 00000100:00100000:1.0:1787365349.434722:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024504960 00000100:00100000:1.0:1787365349.434761:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787365349.434768:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+9:14426:x1874188024504960:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787365349.435104:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+9:14426:x1874188024504960:12345-0@lo:502:llog_process_th.0 Request processed in 335us (417us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365349.435121:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:1.0:1787365349.435162:0:14426:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27867ad9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365349.435180:0:14426:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb408000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14426:1874188024504960:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787365349.435283:0:14426:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787365349.435287:0:14426:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365349.435289:0:14426:0:(obd_config.c:1563:class_process_config()) marker 25 (0x2) lustre sys.jobid_var 00000040:00080000:1.0:1787365349.435293:0:14426:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 37 count 37 00000020:01000000:3.0:1787365349.435789:0:14390:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-MDT0000 gen 1-36 (rc=0) 10000000:01000000:3.0:1787365349.435808:0:14390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-MDT0000' succeeded (0). 00010000:00010000:3.0:1787365349.435831:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2788f44200/0x872d29295eb47cc4 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47ccb expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365349.435907:0:14390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2788f44200/0x872d29295eb47cc4 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47ccb expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365349.435998:0:14390:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f27b63ba000 from 1 10000000:01000000:2.0:1787365349.436002:0:14390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:2.0:1787365349.436033:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27bb708a00/0x872d29295eb47d42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365349.436041:0:14390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27bb708a00/0x872d29295eb47d42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365349.436058:0:14390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27bb708a00/0x872d29295eb47d42 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365349.436074:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbad8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024505088:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787365349.436111:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365349.436184:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278834e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365349.436320:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024505088 00000100:00100000:3.0:1787365349.436326:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024505088 00000100:00100000:3.0:1787365349.436394:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787365349.436402:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+9:14390:x1874188024505088:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787365349.436412:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365349.436426:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d49 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb47d42 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365349.436445:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb47d42 expref: 10 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365349.436455:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47d42 expref: 10 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365349.436469:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44800, rc 0) 00000100:00100000:3.0:1787365349.436520:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+10:14390:x1874188024505088:12345-0@lo:101:mount.lustre.0 Request processed in 118us (407us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365349.436526:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787365349.436583:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbad8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024505088:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787365349.436595:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27bb708a00/0x872d29295eb47d42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47d49 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365349.436605:0:14390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27bb708a00/0x872d29295eb47d42 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb47d49 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365349.437193:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbad8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024505216:0@lo:256:mount.lustre.0 00000100:00100000:2.0:1787365349.437350:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365349.437530:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278834e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365349.437921:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024505216 00000100:00100000:1.0:1787365349.437928:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024505216 00000100:00100000:1.0:1787365349.437955:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787365349.437962:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+10:14390:x1874188024505216:12345-0@lo:256:mount.lustre.0 20000000:01000000:1.0:1787365349.437980:0:14403:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 1048576. 20000000:01000000:1.0:1787365349.437985:0:14403:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 0, version 1 00000100:00100000:1.0:1787365349.438059:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+10:14390:x1874188024505216:12345-0@lo:256:mount.lustre.0 Request processed in 97us (709us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365349.438067:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:2.0:1787365349.438140:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbad8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024505216:0@lo:256:mount.lustre.0 10000000:01000000:2.0:1787365349.438745:0:14390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:2.0:1787365349.438764:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27bb708a00/0x872d29295eb47d42 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47d49 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365349.438774:0:14390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27bb708a00/0x872d29295eb47d42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47d49 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365349.438782:0:14390:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f27b63ba000 from 1 10000000:01000000:2.0:1787365349.438784:0:14390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787365349.438816:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27bb708200/0x872d29295eb47d50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365349.438824:0:14390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27bb708200/0x872d29295eb47d50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365349.438832:0:14390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27bb708200/0x872d29295eb47d50 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365349.439103:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbad8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024505344:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787365349.439141:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365349.439175:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278834e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365349.439297:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024505344 00000100:00100000:1.0:1787365349.439302:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024505344 00000100:00100000:1.0:1787365349.439325:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787365349.439332:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+10:14390:x1874188024505344:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787365349.439342:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365349.439355:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2798115000/0x872d29295eb47d57 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb47d50 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.439374:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2798115000/0x872d29295eb47d57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb47d50 expref: 11 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.439384:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2798115000/0x872d29295eb47d57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47d50 expref: 11 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.439399:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115000, rc 0) 00000100:00100000:1.0:1787365349.439433:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+11:14390:x1874188024505344:12345-0@lo:101:mount.lustre.0 Request processed in 101us (291us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365349.439440:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:2.0:1787365349.439557:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbad8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024505344:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787365349.439570:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27bb708200/0x872d29295eb47d50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47d57 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365349.439579:0:14390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27bb708200/0x872d29295eb47d50 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb47d57 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365349.439686:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbad8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024505472:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787365349.439712:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365349.439761:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278834e9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365349.439885:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024505472 00000100:00100000:3.0:1787365349.439890:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024505472 00000100:00100000:0.0:1787365349.440067:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:0.0:1787365349.440077:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+11:14390:x1874188024505472:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787365349.440592:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+11:14390:x1874188024505472:12345-0@lo:501:mount.lustre.0 Request processed in 516us (878us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365349.440599:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787365349.440698:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbad8380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024505472:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787365349.440733:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024505600:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787365349.440774:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365349.441020:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2784c6d900 going to sleep for 11 seconds 00000100:00100000:1.0:1787365349.441063:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024505600 00000100:00100000:1.0:1787365349.441068:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024505600 00000100:00100000:1.0:1787365349.441093:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787365349.441099:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+11:14390:x1874188024505600:12345-0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787365349.441300:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+11:14390:x1874188024505600:12345-0@lo:503:mount.lustre.0 Request processed in 200us (525us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365349.441307:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:3.0:1787365349.441509:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024505600:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787365349.441979:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb408000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14434:1874188024505728:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787365349.442020:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365349.442041:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024505728 00000100:00100000:1.0:1787365349.442045:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024505728 00000100:00100000:1.0:1787365349.442079:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787365349.442086:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+11:14434:x1874188024505728:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787365349.442434:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+11:14434:x1874188024505728:12345-0@lo:502:llog_process_th.0 Request processed in 347us (414us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365349.442442:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787365349.442490:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27a5abf600 going to sleep for 11 seconds 00000100:00100000:1.0:1787365349.442504:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb408000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14434:1874188024505728:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787365349.442526:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787365349.442534:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365349.442541:0:14434:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:1.0:1787365349.442549:0:14434:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f27b63ba000 00000020:00000080:1.0:1787365349.442551:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787365349.442558:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787365349.442560:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365349.442561:0:14434:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:1.0:1787365349.442564:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787365349.442566:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365349.442567:0:14434:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:1.0:1787365349.442571:0:14434:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f27b63ba000 00000020:00000080:1.0:1787365349.442573:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:1.0:1787365349.442655:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787365349.442659:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365349.442660:0:14434:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:1.0:1787365349.442663:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:1.0:1787365349.442665:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365349.442667:0:14434:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:1.0:1787365349.442670:0:14434:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f27b63ba000 00000020:00000080:1.0:1787365349.442672:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000100:00100000:1.0:1787365349.442704:0:14434:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb408000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14434:1874188024505856:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787365349.442737:0:14434:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365349.442757:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024505856 00000100:00100000:1.0:1787365349.442761:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024505856 00000100:00100000:1.0:1787365349.442783:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787365349.442790:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+11:14434:x1874188024505856:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787365349.444059:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+11:14434:x1874188024505856:12345-0@lo:502:llog_process_th.0 Request processed in 1265us (1318us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365349.444070:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:1.0:1787365349.444117:0:14434:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27867ad9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365349.444134:0:14434:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb408000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14434:1874188024505856:0@lo:502:llog_process_th.0 00000020:01000000:1.0:1787365349.444169:0:14434:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:1.0:1787365349.444176:0:14434:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:1.0:1787365349.444178:0:14434:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:1.0:1787365349.444182:0:14434:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 10 count 10 00000020:01000000:0.0:1787365349.446681:0:14390:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:0.0:1787365349.446712:0:14390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:0.0:1787365349.446730:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27bb708200/0x872d29295eb47d50 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47d57 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365349.446741:0:14390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27bb708200/0x872d29295eb47d50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47d57 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365349.446791:0:14390:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:0.0:1787365349.446794:0:14390:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f27b63ba000 10000000:01000000:0.0:1787365349.446796:0:14390:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f27b63ba000 10000000:01000000:0.0:1787365349.446800:0:14390:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787365349.446805:0:14390:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f27b63ba000 from 1 10000000:01000000:0.0:1787365349.446808:0:14390:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:0.0:1787365349.446911:0:14390:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27b6e22a00/0x872d29295eb47d5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365349.446921:0:14390:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27b6e22a00/0x872d29295eb47d5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365349.446933:0:14390:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27b6e22a00/0x872d29295eb47d5e lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365349.446956:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2798099f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024505984:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787365349.447011:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365349.447044:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278ff1e9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365349.447109:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024505984 00000100:00100000:1.0:1787365349.447115:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024505984 00000100:00100000:1.0:1787365349.447158:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:1.0:1787365349.447166:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+11:14390:x1874188024505984:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787365349.447178:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365349.447191:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2798115600/0x872d29295eb47d65 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb47d5e expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.447330:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2798115600/0x872d29295eb47d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb47d5e expref: 12 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.447342:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2798115600/0x872d29295eb47d65 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47d5e expref: 12 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.447350:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115600, rc 0) 00000100:00100000:1.0:1787365349.447384:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:14390:x1874188024505984:12345-0@lo:101:mount.lustre.0 Request processed in 219us (373us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365349.447390:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787365349.447954:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2798099f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024505984:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787365349.447969:0:14390:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27b6e22a00/0x872d29295eb47d5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47d65 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365349.447988:0:14390:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27b6e22a00/0x872d29295eb47d5e lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb47d65 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365349.448038:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2798099f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024506112:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787365349.448063:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365349.448084:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278ff1e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787365349.448098:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024506112 00000100:00100000:0.0:1787365349.448101:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024506112 00000100:00100000:0.0:1787365349.448128:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787365349.448134:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:14390:x1874188024506112:12345-0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787365349.449567:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:14390:x1874188024506112:12345-0@lo:501:mount.lustre.0 Request processed in 1426us (1496us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365349.449578:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:0.0:1787365349.449643:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2798099f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024506112:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787365349.449682:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2798099f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024506240:0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787365349.449720:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365349.449745:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278ff1e9c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787365349.449761:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024506240 00000100:00100000:0.0:1787365349.449766:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024506240 00000100:00100000:0.0:1787365349.449800:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:0.0:1787365349.449807:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:14390:x1874188024506240:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787365349.451091:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:14390:x1874188024506240:12345-0@lo:503:mount.lustre.0 Request processed in 1279us (1365us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365349.451101:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787365349.451380:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2798099f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024506240:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787365349.453152:0:14436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb408000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14436:1874188024506368:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787365349.453299:0:14436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365349.453334:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024506368 00000100:00100000:1.0:1787365349.453340:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024506368 00000100:00100000:1.0:1787365349.453373:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787365349.453381:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:14436:x1874188024506368:12345-0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787365349.453611:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:14436:x1874188024506368:12345-0@lo:502:llog_process_th.0 Request processed in 230us (312us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365349.453619:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00100000:1.0:1787365349.453686:0:14436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27a5abfc00 going to sleep for 11 seconds 00000100:00100000:1.0:1787365349.453703:0:14436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb408000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14436:1874188024506368:0@lo:502:llog_process_th.0 00000020:01000004:1.0:1787365349.453765:0:14436:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-MDT0000 (typ=lwp) 00000020:00000080:1.0:1787365349.453779:0:14436:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-MDT0000 (ffff9f27872bcd28) 00000020:00000080:1.0:1787365349.453797:0:14436:0:(obd_config.c:720:class_attach_name()) OBD: dev 10 attached type lwp with refcount 2 00000020:01000004:1.0:1787365349.456495:0:14436:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f27b63ba000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787365349.456504:0:14436:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f27b63ba000 from lustre-MDT0000, refs=4 00000020:01000004:1.0:1787365349.456508:0:14436:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f27b63ba000 4 00010000:00080000:1.0:1787365349.456541:0:14436:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f27a032a000@lustre-MDT0000-lwp-MDT0000: add connection 192.168.203.113@tcp at head 00010000:00010000:1.0:1787365349.461618:0:14436:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-MDT0000-3 is initialized 00000020:00000080:1.0:1787365349.463076:0:14436:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-MDT0000 (uuid lustre-MDT0000-lwp-MDT0000_UUID) 00000010:01000000:1.0:1787365349.463109:0:14436:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:1.0:1787365349.463123:0:14436:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000, cookie 0x872d29295eb47d73 00000100:00080000:1.0:1787365349.463132:0:14436:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-MDT0000: connect to NID 0@lo last attempt 0 00000100:00080000:1.0:1787365349.463138:0:14436:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f27a032a000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1787365349.463185:0:14436:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f27bb408000 x1874188024506496/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787365349.463235:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874188024506496:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787365349.463300:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787365349.463354:0:14436:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID 00000100:00100000:2.0:1787365349.463504:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024506496 00000100:00100000:2.0:1787365349.463511:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024506496 00000100:00100000:2.0:1787365349.463538:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787365349.463545:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb40b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874188024506496:12345-0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787365349.463604:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb40b480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874188024506496:12345-0@lo:38:llog_process_th.0 Request processed in 57us (303us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787365349.463617:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787365349.464016:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:1.0:1787365349.464024:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9f27a032a000 lustre-MDT0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787365349.464027:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-MDT0000_UUID on 0@lo failed (-11) 00000100:00100000:1.0:1787365349.464038:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874188024506496:0@lo:38:llog_process_th.0 00000100:00100000:1.0:1787365349.467367:0:14436:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb408000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14436:1874188024506624:0@lo:502:llog_process_th.0 00000100:00100000:1.0:1787365349.467447:0:14436:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365349.467497:0:14436:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27a5abfd80 going to sleep for 11 seconds 00000100:00100000:0.0:1787365349.468922:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024506624 00000100:00100000:0.0:1787365349.468935:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024506624 00000100:00100000:0.0:1787365349.469514:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787365349.469526:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:14436:x1874188024506624:12345-0@lo:502:llog_process_th.0 00000100:00100000:0.0:1787365349.469833:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:14436:x1874188024506624:12345-0@lo:502:llog_process_th.0 Request processed in 309us (2385us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365349.469909:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:1.0:1787365349.470673:0:14436:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb408000 pname:cluuid:pid:xid:nid:opc:job llog_process_th:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14436:1874188024506624:0@lo:502:llog_process_th.0 00000040:00080000:1.0:1787365349.470715:0:14436:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 42 count 42 00000020:01000000:2.0:1787365349.470968:0:14390:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:2.0:1787365349.470989:0:14390:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:2.0:1787365349.471011:0:14390:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27b6e22a00/0x872d29295eb47d5e lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47d65 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365349.471020:0:14390:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27b6e22a00/0x872d29295eb47d5e lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47d65 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:2.0:1787365349.471067:0:14390:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:2.0:1787365349.471070:0:14390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787365349.471071:0:14390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787365349.471072:0:14390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787365349.471073:0:14390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787365349.471075:0:14390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787365349.471076:0:14390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787365349.471078:0:14390:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787365349.471080:0:14390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787365349.471081:0:14390:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787365349.471084:0:14390:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-MDT0000 0x40020005 00000020:01000004:2.0:1787365349.471086:0:14390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:2.0:1787365349.471088:0:14390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:2.0:1787365349.471089:0:14390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:2.0:1787365349.471090:0:14390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:2.0:1787365349.471091:0:14390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:2.0:1787365349.471092:0:14390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:2.0:1787365349.471093:0:14390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:2.0:1787365349.471094:0:14390:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:2.0:1787365349.471095:0:14390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:2.0:1787365349.471096:0:14390:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:2.0:1787365349.471127:0:14390:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-MDT0000 00000100:00100000:2.0:1787365349.471143:0:14390:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbad9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024506752:0@lo:253:mount.lustre.0 00000100:00100000:2.0:1787365349.471391:0:14390:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365349.471458:0:14390:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2686c77480 going to sleep for 11 seconds 00000100:00100000:0.0:1787365349.471528:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024506752 00000100:00100000:0.0:1787365349.471534:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024506752 00000100:00100000:0.0:1787365349.471568:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787365349.471576:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:14390:x1874188024506752:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787365349.471609:0:14403:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:0.0:1787365349.471643:0:14403:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:0.0:1787365349.521329:0:14403:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:0.0:1787365349.521347:0:14403:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-MDT0000, index=0, rc=0 20000000:01000000:3.0:1787365349.521946:0:14424:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:3.0:1787365349.521952:0:14424:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:3.0:1787365349.521973:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f2788f45000/0x872d29295eb47d7a lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365349.521991:0:14424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d49 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47d42 expref: 12 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365349.522000:0:14424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f2788f45000/0x872d29295eb47d7a lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365349.522034:0:14424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d49 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb47d42 expref: 12 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365349.522047:0:14424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb47d42 expref: 12 pid: 14402 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365349.522078:0:14424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf91880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14424:1874188024506880:0@lo:104: 00000100:00100000:3.0:1787365349.522137:0:14424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365349.522182:0:14424:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278fd56600 going to sleep for 11 seconds 00000100:00100000:1.0:1787365349.522304:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024506880 00000100:00100000:1.0:1787365349.522311:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024506880 00000100:00100000:1.0:1787365349.522352:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787365349.522361:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+3:14424:x1874188024506880:12345-0@lo:104: 00010000:00010000:1.0:1787365349.522374:0:14391:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f27bb708a00/0x872d29295eb47d42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb47d49 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.522431:0:14391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787365349.522437:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf91180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+3:14424:x1874188024506880:12345-0@lo:104: Request processed in 78us (300us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365349.522444:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00010000:1.0:1787365349.522462:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365349.522468:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27bb708a00/0x872d29295eb47d42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb47d49 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.522476:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708a00 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:1.0:1787365349.522491:0:14397:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27bb708a00/0x872d29295eb47d42 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb47d49 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.522501:0:14397:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27bb708a00/0x872d29295eb47d42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb47d49 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:1.0:1787365349.522520:0:14397:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27bb708a00/0x872d29295eb47d42 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb47d49 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365349.522589:0:14397:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:1.0:1787365349.522618:0:14397:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27bb708a00/0x872d29295eb47d42 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb47d49 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.522646:0:14397:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:1.0:1787365349.522667:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27bb708a00/0x872d29295eb47d42 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb47d49 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.522674:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27bb708a00/0x872d29295eb47d42 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb47d49 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.522688:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365349.522690:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365349.522692:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365349.522720:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3310:1874188024507008:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787365349.522748:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365349.522798:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024507008 00000100:00100000:1.0:1787365349.522803:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024507008 00010000:00010000:1.0:1787365349.522818:0:14393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d49 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb47d42 expref: 13 pid: 14402 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365349.522839:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787365349.523084:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb408380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+13:3310:x1874188024507008:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787365349.523096:0:14393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365349.523101:0:14393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d49 lrc: 5/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb47d42 expref: 13 pid: 14402 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.523117:0:14393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d49 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb47d42 expref: 13 pid: 14402 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.523133:0:14393:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f2788f45000/0x872d29295eb47d7a lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.523142:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2788f45000/0x872d29295eb47d7a lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50290000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787365349.523153:0:14393:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001202013s 00010000:00010000:1.0:1787365349.523157:0:14393:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f2788f45000/0x872d29295eb47d7a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.523164:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f2788f45000/0x872d29295eb47d7a lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.523171:0:14393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f2788f45000/0x872d29295eb47d7a lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.523177:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f2788f45000/0x872d29295eb47d7a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.523183:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45000 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365349.523187:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f2788f45000/0x872d29295eb47d7a lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.523194:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f2788f45000/0x872d29295eb47d7a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365349.523344:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d49 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb47d42 expref: 13 pid: 14402 timeout: 566 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365349.523356:0:14424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf91880 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14424:1874188024506880:0@lo:104: 00010000:00010000:3.0:1787365349.523372:0:14424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f2788f45000/0x872d29295eb47d7a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365349.523382:0:14424:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: MGS lock: ffff9f2788f45000/0x872d29295eb47d7a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365349.523388:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f2788f45000/0x872d29295eb47d7a lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.523991:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f2788f45000/0x872d29295eb47d7a lrc: 3/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.524009:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2788f45000/0x872d29295eb47d7a lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365349.524023:0:14393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365349.524074:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb408380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:3310:x1874188024507008:12345-0@lo:103:ldlm_bl.0 Request processed in 1030us (1325us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365349.524082:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787365349.524368:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb408000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3310:1874188024507008:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787365349.533795:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+11:14390:x1874188024506752:12345-0@lo:253:mount.lustre.0 Request processed in 62209us (62395us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365349.533809:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:1.0:1787365349.533929:0:14390:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbad9f80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14390:1874188024506752:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787365349.533944:0:14390:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-MDT0000 got index = 0 00000020:01000004:1.0:1787365349.533947:0:14390:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787365349.533949:0:14390:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-MDT0000 00000020:01000004:1.0:1787365349.533951:0:14390:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787365349.533952:0:14390:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787365349.533953:0:14390:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787365349.533954:0:14390:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787365349.533956:0:14390:0:(tgt_mount.c:1182:server_mti_print()) LDD_F_SV_TYPE_MDT 00000020:01000004:1.0:1787365349.533957:0:14390:0:(tgt_mount.c:1186:server_mti_print()) LDD_F_SV_TYPE_MGS 00000020:01000004:1.0:1787365349.533959:0:14390:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787365349.533961:0:14390:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787365349.533975:0:14390:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-MDT0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787365349.542602:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xa:0x0] (8/8/4) registered 00080000:10000000:1.0:1787365349.542806:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787365349.543512:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00080000:10000000:1.0:1787365349.543703:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787365349.544453:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xc:0x0] (8/8/4) registered 00080000:10000000:0.0:1787365349.544909:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00080000:10000000:0.0:1787365349.545813:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xd:0x0] (8/8/4) registered 00080000:10000000:0.0:1787365349.546040:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20001:0x0] (8/8/1) registered 00080000:10000000:0.0:1787365349.546420:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xe:0x0] (8/8/4) registered 00080000:10000000:0.0:1787365349.546747:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20002:0x0] (8/8/1) registered 00080000:10000000:0.0:1787365349.547434:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0xf:0x0] (8/8/4) registered 00080000:10000000:0.0:1787365349.547602:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000005:0x20003:0x0] (8/8/1) registered 00000020:00080000:2.0:1787365349.583499:0:14390:0:(update_trans.c:1496:distribute_txn_commit_batchid_init()) lustre-MDT0000: committed batchid 8 00000040:01000000:2.0:1787365349.583962:0:14390:0:(llog_obd.c:197:llog_setup()) obd lustre-MDT0000-osd ctxt 16 is initialized 00000040:01000000:2.0:1787365349.584327:0:14447:0:(llog_osd.c:2246:llog_osd_get_cat_list()) cat list: disk size=32, read=32 00000040:00080000:2.0:1787365349.584390:0:14447:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000020:00080000:3.0:1787365349.586413:0:14446:0:(update_trans.c:1539:distribute_txn_commit_thread()) lustre-MDT0000: start commit thread committed batchid 8 00000020:00080000:3.0:1787365349.586419:0:14446:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 00000040:00080000:2.0:1787365349.590154:0:14447:0:(llog.c:862:llog_process_thread()) stop processing catalog [0x200000400:0x1:0x0] index 261376 count 1 00000004:00080000:2.0:1787365349.590948:0:14447:0:(lod_dev.c:521:lod_sub_recovery_thread()) lustre-MDT0000-osd retrieved update log, duration 0, retries 0 00000004:00080000:2.0:1787365349.590953:0:14447:0:(lod_dev.c:545:lod_sub_recovery_thread()) lustre-MDT0000 got update logs from all MDTs. 00000040:01000000:0.0:1787365349.591934:0:14390:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 12 is initialized 00000040:00080000:0.0:1787365349.592181:0:14390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000004:00000080:0.0:1787365349.592795:0:14390:0:(mdd_device.c:555:mdd_changelog_llog_init()) changelog starting index=0 00000040:01000000:0.0:1787365349.592812:0:14390:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 14 is initialized 00000040:00080000:0.0:1787365349.592979:0:14390:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787365349.594190:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x5:0x0] index 64768 count 1 00000040:00080000:0.0:1787365349.595059:0:14390:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x6:0x0] index 64768 count 1 00000040:01000000:0.0:1787365349.595096:0:14390:0:(llog_obd.c:197:llog_setup()) obd lustre-MDD0000 ctxt 15 is initialized 00080000:10000000:0.0:1787365349.599362:0:14390:0:(osd_index.c:2103:osd_index_try()) lustre-MDT0000: index object [0x200000003:0x36:0x0] (8/8/4) registered 00000001:00000004:0.0:1787365349.605153:0:14390:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000001:00080000:0.0:1787365349.641334:0:14390:0:(tgt_lastrcvd.c:222:tgt_reply_header_read()) lustre-MDT0000: read reply_data header. magic=0xbdabda01 header_size=32 reply_size=32 00000004:00000080:0.0:1787365349.641368:0:14390:0:(mdd_device.c:2304:mdd_iocontrol()) lustre-MDD0000: cmd=c00866e6 len=0 karg=ffffaab440d7f988 00100000:10000000:0.0:1787365349.641376:0:14390:0:(lfsck_lib.c:3085:lfsck_start()) lustre-MDT0000-osd: start master thread 00000020:01000004:0.0:1787365349.642577:0:14390:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:0.0:1787365349.642606:0:14390:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:0.0:1787365349.642700:0:14390:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=46 00000080:00000004:0.0:1787365349.642726:0:14390:0:(super25.c:182:lustre_fill_super()) lustre-mdt1/mdt1: Mount complete 00010000:00010000:3.0:1787365350.069518:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787365350.194771:0:14405:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787365350.194779:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f27b63ba000 from 6 10000000:01000000:1.0:1787365350.194784:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787365350.194835:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2798115c00/0x872d29295eb47d81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365350.194858:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2798115c00/0x872d29295eb47d81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365350.195009:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2798115c00/0x872d29295eb47d81 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365350.195103:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb40b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024507136:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787365350.195175:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365350.195240:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024507136 00000100:00100000:2.0:1787365350.195247:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024507136 00000100:00100000:2.0:1787365350.195301:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787365350.195310:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+11:14405:x1874188024507136:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787365350.195321:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365350.195347:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27bb709400/0x872d29295eb47d88 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb47d81 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365350.195348:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2782d39f00 going to sleep for 11 seconds 00010000:00010000:2.0:1787365350.195373:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27bb709400/0x872d29295eb47d88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb47d81 expref: 12 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365350.195384:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27bb709400/0x872d29295eb47d88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47d81 expref: 12 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365350.195394:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb709400, rc 0) 00000100:00100000:2.0:1787365350.195440:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:14405:x1874188024507136:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 131us (265us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365350.195446:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:1.0:1787365350.195489:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb40b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024507136:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787365350.195504:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2798115c00/0x872d29295eb47d81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47d88 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365350.195526:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2798115c00/0x872d29295eb47d81 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb47d88 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365350.195582:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb40b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024507264:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787365350.195613:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365350.195661:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2782d39f00 going to sleep for 11 seconds 00000100:00100000:3.0:1787365350.195694:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024507264 00000100:00100000:3.0:1787365350.195699:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024507264 00000100:00100000:3.0:1787365350.195733:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 24 00000100:00100000:3.0:1787365350.195740:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:14405:x1874188024507264:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:3.0:1787365350.195755:0:14401:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:3.0:1787365350.195773:0:14401:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:3.0:1787365350.195777:0:14401:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 6 00000100:00100000:3.0:1787365350.195872:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:14405:x1874188024507264:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 131us (257us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365350.195888:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 24 00000100:00100000:1.0:1787365350.195973:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb40b100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024507264:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787365350.196013:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787365350.196031:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2798115c00/0x872d29295eb47d81 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47d88 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365350.196041:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2798115c00/0x872d29295eb47d81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47d88 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787365350.515526:0:14442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787365351.093755:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:1.0:1787365351.540930:0:14442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787365352.124191:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365353.138770:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365354.169404:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787365354.290221:0:14690:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00000100:00080000:3.0:1787365354.869294:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787365354.869300:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787365354.869303:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787365354.869305:0:36:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787365354.869307:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-lwp-MDT0000_UUID->lustre-MDT0000_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 0 00000100:00080000:3.0:1787365354.869310:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-MDT0000_UUID: starting recovery 00000100:00080000:3.0:1787365354.869314:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f27a032a000 lustre-MDT0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787365354.869325:0:36:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-MDT0000: import ffff9f27a032a000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1787365354.869347:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f27baf90700 x1874188024507520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787365354.869380:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3311:1874188024507392:0@lo:400:kworker.0 00000100:00100000:3.0:1787365354.869455:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365354.869513:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874188024507520:0@lo:38:kworker.0 00000100:00100000:3.0:1787365354.869541:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365354.869574:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024507392 00000100:00100000:3.0:1787365354.869581:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024507392 00000100:00100000:3.0:1787365354.869617:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787365354.869643:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:3311:x1874188024507392:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365354.869690:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:3311:x1874188024507392:12345-0@lo:400:kworker.0 Request processed in 65us (234us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365354.869703:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 25 00000100:00100000:3.0:1787365354.869749:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3311:1874188024507392:0@lo:400:kworker.0 00000100:00100000:1.0:1787365354.872125:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024507520 00000100:00100000:1.0:1787365354.872136:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024507520 00000100:00100000:1.0:1787365354.872171:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787365354.872179:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:0+-99:3309:x1874188024507520:12345-0@lo:38:kworker.0 00010000:00080000:1.0:1787365354.872207:0:14410:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-MDT0000_UUID@0@lo t0 exp 0000000000000000 cur 472 last 0 00000020:00000080:1.0:1787365354.872416:0:14410:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-MDT0000_UUID, cookie 0x872d29295eb47d8f 00000004:00100000:1.0:1787365354.872432:0:14410:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787365354.872571:0:14410:0:(import.c:65:import_set_state_nolock()) ffff9f27b6284800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787365354.872671:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf90000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3309:x1874188024507520:12345-0@lo:38:kworker.0 Request processed in 490us (3127us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365354.872678:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:3.0:1787365354.874456:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f27baf90700 x1874188024507520/t0(0) o38->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787365364 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787365354.874476:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787365354.874484:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-MDT0000: Resetting ns_connect_flags to server flags: 0x2041401047000020 00000100:00080000:3.0:1787365354.874489:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787365354.874492:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9f27a032a000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787365354.874499:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-MDT0000_UUID:3309:1874188024507520:0@lo:38:kworker.0 00010000:00010000:2.0:1787365355.187948:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365356.218173:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787365357.003306:0:14842:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007fff2ace7800 20000000:00000080:2.0:1787365357.003324:0:14842:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f2784308800 uarg=0000000000000000 20000000:01000000:2.0:1787365357.003356:0:14842:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='debug_raw_pointers=Y' 20000000:01000000:2.0:1787365357.003363:0:14842:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'debug_raw_pointers=Y' 20000000:01000000:2.0:1787365357.003368:0:14842:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/debug_raw_pointers=Y del=0 00000040:00080000:1.0:1787365357.006092:0:14843:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 2 count 10 20000000:00000400:3.0:1787365357.006253:0:14842:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/debug_raw_pointers=Y (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787365357.016959:0:14842:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:3.0:1787365357.016989:0:14842:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d96 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365357.017009:0:14842:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f2798115000/0x872d29295eb47d57 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47d50 expref: 11 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365357.017016:0:14842:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d96 lrc: 4/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365357.017811:0:14842:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f2798115000/0x872d29295eb47d57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb47d50 expref: 11 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365357.017834:0:14842:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f2798115000/0x872d29295eb47d57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb47d50 expref: 11 pid: 14403 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365357.017870:0:14842:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf90700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14842:1874188024507648:0@lo:104: 00000100:00100000:2.0:1787365357.018114:0:14842:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365357.018168:0:14842:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bc726c00 going to sleep for 11 seconds 00000100:00100000:0.0:1787365357.018771:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024507648 00000100:00100000:0.0:1787365357.018779:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024507648 00000100:00100000:0.0:1787365357.018825:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787365357.018834:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+3:14842:x1874188024507648:12345-0@lo:104: 00010000:00010000:0.0:1787365357.018848:0:14392:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f27bb708200/0x872d29295eb47d50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb47d57 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365357.018913:0:14392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787365357.018919:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbadaa00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+3:14842:x1874188024507648:12345-0@lo:104: Request processed in 86us (806us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365357.018925:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:0.0:1787365357.018950:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365357.018956:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27bb708200/0x872d29295eb47d50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb47d57 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365357.018964:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708200 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:0.0:1787365357.018979:0:14397:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27bb708200/0x872d29295eb47d50 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb47d57 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365357.018987:0:14397:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27bb708200/0x872d29295eb47d50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb47d57 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365357.018994:0:14397:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27bb708200/0x872d29295eb47d50 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb47d57 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365357.018999:0:14397:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787365357.019043:0:14397:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27bb708200/0x872d29295eb47d50 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb47d57 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365357.019050:0:14397:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787365357.019068:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27bb708200/0x872d29295eb47d50 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb47d57 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365357.019074:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27bb708200/0x872d29295eb47d50 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb47d57 expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365357.019089:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365357.019091:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365357.019092:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365357.019116:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279809a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3312:1874188024507776:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787365357.019147:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365357.019196:0:14842:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf90700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:14842:1874188024507648:0@lo:104: 00010000:00010000:3.0:1787365357.019219:0:14842:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d96 lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365357.019247:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024507776 00000100:00100000:0.0:1787365357.019252:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024507776 00010000:00010000:0.0:1787365357.019269:0:14394:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f2798115000/0x872d29295eb47d57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb47d50 expref: 12 pid: 14403 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365357.019297:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787365357.019310:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:3312:x1874188024507776:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787365357.019321:0:14394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365357.019326:0:14394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f2798115000/0x872d29295eb47d57 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb47d50 expref: 12 pid: 14403 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365357.019336:0:14394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f2798115000/0x872d29295eb47d57 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb47d50 expref: 12 pid: 14403 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365357.019348:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2798115000/0x872d29295eb47d57 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb47d50 expref: 12 pid: 14403 timeout: 574 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365357.019360:0:14394:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d96 lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365357.019367:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d96 lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365357.019378:0:14394:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d96 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365357.019383:0:14394:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d96 lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365357.019389:0:14394:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d96 lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365357.019394:0:14394:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d96 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365357.019399:0:14394:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44800 already unused, calling callback (ffffffffc1672420) 00010000:00010000:0.0:1787365357.019402:0:14394:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d96 lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365357.019414:0:14394:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d96 lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365357.019425:0:14394:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d96 lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365357.019592:0:14394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365357.019862:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798099500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+11:3312:x1874188024507776:12345-0@lo:103:ldlm_bl.0 Request processed in 551us (713us total) trans 0 rc 0/0 00010000:00010000:3.0:1787365357.019865:0:14842:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d96 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365357.019874:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00010000:3.0:1787365357.019878:0:14842:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d96 lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365357.019887:0:14842:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2788f44800/0x872d29295eb47d96 lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14842 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365357.019907:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279809a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3312:1874188024507776:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787365357.236192:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365358.268767:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:3.0:1787365358.269384:0:14405:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787365358.269389:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f27b63ba000 from 10 10000000:01000000:3.0:1787365358.269393:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787365358.269443:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2788f44400/0x872d29295eb47d9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365358.269455:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2788f44400/0x872d29295eb47d9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365358.269466:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2788f44400/0x872d29295eb47d9d lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365358.269490:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024507904:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787365358.269555:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365358.269613:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bc726540 going to sleep for 11 seconds 00000100:00100000:0.0:1787365358.270572:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024507904 00000100:00100000:0.0:1787365358.270580:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024507904 00000100:00100000:0.0:1787365358.270654:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:0.0:1787365358.270663:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+11:14405:x1874188024507904:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787365358.270678:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365358.270695:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27b6e23000/0x872d29295eb47da4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb47d9d expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365358.270720:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27b6e23000/0x872d29295eb47da4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb47d9d expref: 12 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365358.270731:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27b6e23000/0x872d29295eb47da4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47d9d expref: 12 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365358.270741:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27b6e23000, rc 0) 00000100:00100000:0.0:1787365358.270796:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:14405:x1874188024507904:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 134us (1240us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365358.270809:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:3.0:1787365358.273118:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024507904:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787365358.273144:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2788f44400/0x872d29295eb47d9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47da4 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365358.273156:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2788f44400/0x872d29295eb47d9d lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb47da4 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365358.273238:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024508032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365358.273292:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365358.273324:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bc726540 going to sleep for 11 seconds 00000100:00100000:2.0:1787365358.275875:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024508032 00000100:00100000:2.0:1787365358.275887:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024508032 00000100:00100000:2.0:1787365358.275933:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787365358.275942:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:14405:x1874188024508032:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787365358.276199:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:14405:x1874188024508032:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 257us (2913us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365358.276207:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787365358.276273:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf90700 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024508032:0@lo:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787365358.276320:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbada680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024508160:0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787365358.276362:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365358.276389:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2797a56900 going to sleep for 11 seconds 00000100:00100000:2.0:1787365358.276402:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024508160 00000100:00100000:2.0:1787365358.276405:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024508160 00000100:00100000:2.0:1787365358.276434:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787365358.276440:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:14405:x1874188024508160:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:2.0:1787365358.276559:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:14405:x1874188024508160:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 118us (196us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365358.276565:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787365358.276595:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbada680 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024508160:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787365358.277236:0:14903:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:2.0:1787365358.277275:0:14405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:2.0:1787365358.277291:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787365358.277300:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2788f44400/0x872d29295eb47d9d lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47da4 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365358.277310:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2788f44400/0x872d29295eb47d9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47da4 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365359.288058:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365359.996128:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787365349/real 1787365349] req@ffff9f27bb40ad80 x1874188024504832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787365359 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365359.996159:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f27bb40ad80 x1874188024504832/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787365359 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365359.996170:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787365349/real 1787365349] req@ffff9f27bb409880 x1874188024504704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787365359 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365359.996182:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f27bb409880 x1874188024504704/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787365359 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00080000:1.0:1787365359.996208:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9f27bbae3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787365359.996219:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787365359.996223:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb40ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024504832:0@lo:8:llog_process_th.0 00000100:00080000:1.0:1787365359.996228:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9f27bb87d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:1.0:1787365359.996232:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:1.0:1787365359.996245:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024504704:0@lo:8:llog_process_th.0 00000100:00080000:2.0:1787365359.996722:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787365359.996726:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:2.0:1787365359.996729:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f27bb87d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787365359.996733:0:36:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 466 00000100:00080000:2.0:1787365359.996738:0:36:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787365359.996744:0:36:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f27bb87d800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1787365359.996762:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f27bbadb100 x1874188024508416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787365359.996774:0:36:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787365359.996777:0:36:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787365359.996779:0:36:0:(import.c:65:import_set_state_nolock()) ffff9f27bbae3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787365359.996782:0:36:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 466 00000100:00080000:2.0:1787365359.996784:0:36:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 5s 00000100:00080000:2.0:1787365359.996787:0:36:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f27bbae3800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1787365359.996799:0:36:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f27bbadb480 x1874188024508544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787365359.996852:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3313:1874188024508288:0@lo:400:kworker.0 00000100:00100000:2.0:1787365359.996911:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365359.996963:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024508672:0@lo:400:kworker.0 00000100:00100000:2.0:1787365359.996992:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365359.997023:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024508288 00000100:00100000:2.0:1787365359.997030:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024508288 00000100:00100000:2.0:1787365359.997067:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787365359.997075:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:3313:x1874188024508288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365359.997118:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:3313:x1874188024508288:12345-0@lo:400:kworker.0 Request processed in 44us (207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365359.997124:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 29 00000100:00100000:2.0:1787365359.997159:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024508672 00000100:00100000:2.0:1787365359.997163:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024508672 00000100:00100000:2.0:1787365359.997183:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787365359.997190:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024508672:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365359.997347:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024508672:12345-0@lo:400:kworker.0 Request processed in 158us (354us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365359.997354:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:2.0:1787365359.997386:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f27bbadad80 x1874188024508672/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365375 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365359.997397:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024508672:0@lo:400:kworker.0 00000100:00100000:2.0:1787365359.997428:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3313:1874188024508288:0@lo:400:kworker.0 00000100:00100000:1.0:1787365359.998777:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024508416:0@lo:8:kworker.0 00000400:00000100:1.0:1787365359.998815:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874188024508416 offset 0 length 520: 4 00000100:00100000:1.0:1787365359.998842:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbadb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024508544:0@lo:8:kworker.0 00000400:00000100:1.0:1787365359.998858:0:3309:0:(lib-move.c:4357:lnet_parse_put()) Dropping PUT from 12345-0@lo portal 28 match 1874188024508544 offset 0 length 520: 4 00010000:00010000:1.0:1787365360.312956:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365361.336780:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787365361.780015:0:14442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787365362.354787:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787365362.372319:0:15090:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787365362.372333:0:15090:0:(obd_mount.c:926:lmd_print()) device: lustre-ost1/ost1 00000080:01200004:2.0:1787365362.372466:0:15090:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f2794eb2000 00000020:01000004:2.0:1787365362.372481:0:15090:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0000, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787365362.372493:0:15090:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0000-osd (typ=osd-zfs) 00000020:00000080:2.0:1787365362.372506:0:15090:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000-osd (ffff9f27bafb0000) 00000020:00000080:2.0:1787365362.372520:0:15090:0:(obd_config.c:720:class_attach_name()) OBD: dev 11 attached type osd-zfs with refcount 2 00100000:10000000:0.0:1787365362.392414:0:15090:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:0.0:1787365362.392874:0:15090:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:0.0:1787365362.393917:0:15090:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:0.0:1787365362.394153:0:15090:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0000: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:0.0:1787365362.394529:0:15090:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0000: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:0.0:1787365362.395094:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled params under 571: rc = 0 00100000:10000000:0.0:1787365362.395264:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-OST0000 under 571: rc = 0 00100000:10000000:0.0:1787365362.395362:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled lustre-client under 571: rc = 0 00100000:10000000:0.0:1787365362.395923:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000 under 770: rc = 0 00100000:10000000:0.0:1787365362.396328:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x20000-OST0000 under 770: rc = 0 00100000:10000000:0.0:1787365362.396604:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000 under 770: rc = 0 00100000:10000000:0.0:1787365362.397128:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000 under 770: rc = 0 00100000:10000000:0.0:1787365362.397516:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x2020000-OST0000 under 770: rc = 0 00100000:10000000:0.0:1787365362.397858:0:15090:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0000: initial OI scrub handled 0x1020000-OST0000 under 770: rc = 0 00000020:00000080:0.0:1787365362.398539:0:15090:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000-osd (uuid lustre-OST0000-osd_UUID) 00080000:01000000:0.0:1787365362.398550:0:15090:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:0.0:1787365362.398561:0:15090:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x872d29295eb47db2 00000020:01000004:0.0:1787365362.398569:0:15090:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0000 on device lustre-ost1/ost1 00000020:01000004:0.0:1787365362.398589:0:15090:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:0.0:1787365362.398593:0:15090:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:0.0:1787365362.398598:0:15090:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0000 00000020:01000004:0.0:1787365362.398603:0:15090:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD OSS (typ=ost) 00000020:00000080:0.0:1787365362.398615:0:15090:0:(genops.c:413:class_newdev()) Allocate new device OSS (ffff9f278456cd28) 00000020:00000080:0.0:1787365362.398753:0:15090:0:(obd_config.c:720:class_attach_name()) OBD: dev 12 attached type ost with refcount 2 00000100:00100000:0.0:1787365362.404216:0:15090:0:(service.c:155:ptlrpc_grow_req_bufs()) ost: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787365362.404427:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 0 min 3 max 116 00000100:00100000:0.0:1787365362.404433:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_000' 00000100:00100000:0.0:1787365362.407808:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 1 min 3 max 116 00000100:00100000:0.0:1787365362.407820:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_001' 00000100:00100000:0.0:1787365362.408363:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost[0] started 2 min 3 max 116 00000100:00100000:0.0:1787365362.408369:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost00_002' 00000100:00100000:0.0:1787365362.410795:0:15090:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_create: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787365362.411091:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 0 min 2 max 16 00000100:00100000:0.0:1787365362.411097:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_000' 00000100:00100000:0.0:1787365362.411888:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost_create[0] started 1 min 2 max 16 00000100:00100000:0.0:1787365362.411895:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_create00_001' 00000100:00100000:0.0:1787365362.434618:0:15090:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_io: allocate 64 new 524288-byte reqbufs (0/64 left), rc = 0 00000100:00100000:1.0:1787365362.438364:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 0 min 3 max 116 00000100:00100000:1.0:1787365362.438376:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_000' 00000100:00100000:2.0:1787365362.442430:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 1 min 3 max 116 00000100:00100000:2.0:1787365362.442446:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_001' 00000100:00100000:2.0:1787365362.443606:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 2 min 3 max 116 00000100:00100000:2.0:1787365362.443617:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_002' 00000100:00100000:2.0:1787365362.459508:0:15090:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_seq: allocate 64 new 32768-byte reqbufs (0/64 left), rc = 0 00000100:00100000:2.0:1787365362.460401:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 0 min 2 max 16 00000100:00100000:2.0:1787365362.460409:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_000' 00000100:00100000:2.0:1787365362.461365:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost_seq[0] started 1 min 2 max 16 00000100:00100000:2.0:1787365362.461373:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_seq00_001' 00000100:00100000:0.0:1787365362.518500:0:15090:0:(service.c:155:ptlrpc_grow_req_bufs()) ost_out: allocate 64 new 1048576-byte reqbufs (0/64 left), rc = 0 00000100:00100000:0.0:1787365362.518792:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 0 min 2 max 16 00000100:00100000:0.0:1787365362.518800:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_000' 00000100:00100000:0.0:1787365362.520865:0:15090:0:(service.c:3462:ptlrpc_start_thread()) ost_out[0] started 1 min 2 max 16 00000100:00100000:0.0:1787365362.520879:0:15090:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_out00_001' 00000020:00000080:1.0:1787365362.529537:0:15090:0:(obd_config.c:826:class_setup()) finished setup of obd OSS (uuid OSS_uuid) 00000020:01000004:1.0:1787365362.529577:0:15090:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost1/ost1 10000000:01000000:1.0:1787365362.529583:0:15090:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0000-osd for locked: rc = 0 00000040:01000000:1.0:1787365362.552662:0:15090:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:1.0:1787365362.552711:0:15090:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0000, fs=lustre, 192.168.203.113@tcp, index=0000, flags=0x20002 00000020:01000004:1.0:1787365362.552716:0:15090:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:1.0:1787365362.552718:0:15090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787365362.552719:0:15090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787365362.552721:0:15090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787365362.552722:0:15090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787365362.552723:0:15090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787365362.552725:0:15090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787365362.552726:0:15090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787365362.552728:0:15090:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787365362.552732:0:15090:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x10020002 00000020:01000004:1.0:1787365362.552734:0:15090:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787365362.552735:0:15090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787365362.552736:0:15090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787365362.552738:0:15090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787365362.552739:0:15090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787365362.552740:0:15090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787365362.552741:0:15090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787365362.552742:0:15090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787365362.552743:0:15090:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:1.0:1787365362.552784:0:15090:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787365362.552805:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024508800:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787365362.552872:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365362.552944:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278fd56b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787365362.553223:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024508800 00000100:00100000:2.0:1787365362.553231:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024508800 00000100:00100000:2.0:1787365362.553287:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787365362.553296:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:15090:x1874188024508800:12345-0@lo:253:mount.lustre.0 20000000:01000000:2.0:1787365362.553324:0:14403:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 0 is registered to MGS. 20000000:01000000:2.0:1787365362.553327:0:14403:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0000 is running on 0@lo 20000000:01000000:2.0:1787365362.553330:0:14403:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 00000100:00100000:2.0:1787365362.563887:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:15090:x1874188024508800:12345-0@lo:253:mount.lustre.0 Request processed in 10581us (11004us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365362.563902:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:1.0:1787365362.565345:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024508800:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787365362.565364:0:15090:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787365362.565367:0:15090:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787365362.565368:0:15090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787365362.565370:0:15090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787365362.565372:0:15090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787365362.565373:0:15090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787365362.565374:0:15090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787365362.565376:0:15090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787365362.565378:0:15090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787365362.565379:0:15090:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:0.0:1787365362.565814:0:15090:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f2794eb2000 from lustre-OST0000 10000000:01000000:0.0:1787365362.565845:0:15090:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0000 from 0 10000000:01000000:0.0:1787365362.565848:0:15090:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0000-0000000000000000 10000000:01000000:0.0:1787365362.565854:0:15090:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f27b6edcd28 local copy 00010000:00010000:0.0:1787365362.565865:0:15090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2798115800/0x872d29295eb47ca8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47caf expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365362.566711:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279809a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024508928:0@lo:501:mount.lustre.0 00000100:00100000:0.0:1787365362.566770:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365362.566817:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2788705240 going to sleep for 11 seconds 00000100:00100000:2.0:1787365362.566894:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024508928 00000100:00100000:2.0:1787365362.566900:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024508928 00000100:00100000:2.0:1787365362.566957:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787365362.566966:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:15090:x1874188024508928:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787365362.567162:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:15090:x1874188024508928:12345-0@lo:501:mount.lustre.0 Request processed in 196us (391us total) trans 0 rc -2/-2 00000100:00100000:2.0:1787365362.567185:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00100000:1.0:1787365362.567382:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279809a300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024508928:0@lo:501:mount.lustre.0 10000000:01000000:1.0:1787365362.567408:0:15090:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:1.0:1787365362.567593:0:15090:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:1.0:1787365362.567602:0:15090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2798115800/0x872d29295eb47ca8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47caf expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.567612:0:15090:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2798115800/0x872d29295eb47ca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47caf expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365362.567668:0:15090:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f2794eb2000 10000000:01000000:1.0:1787365362.567673:0:15090:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:1.0:1787365362.567678:0:15090:0:(mgc_request.c:194:do_config_log_add()) do adding config log nodemap-ffff9f27b6edcd28 10000000:01000000:1.0:1787365362.567681:0:15090:0:(mgc_request.c:68:mgc_name2resid()) log nodemap to resid 0x70616d65646f6e/0x4 (nodemap) 10000000:01000000:1.0:1787365362.567685:0:15090:0:(mgc_request.c:1802:mgc_process_log()) Process log nodemap-ffff9f27b6edcd28 from 1 10000000:01000000:1.0:1787365362.567688:0:15090:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for nodemap (res 0x70616d65646f6e) 00010000:00010000:1.0:1787365362.567713:0:15090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2798114800/0x872d29295eb47dc0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.567728:0:15090:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2798114800/0x872d29295eb47dc0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.567738:0:15090:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2798114800/0x872d29295eb47dc0 lrc: 3/1,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365362.567754:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024509056:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787365362.567783:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365362.567804:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27a024bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787365362.568070:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024509056 00000100:00100000:2.0:1787365362.568075:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024509056 00000100:00100000:2.0:1787365362.568416:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787365362.568426:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+12:15090:x1874188024509056:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787365362.568437:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365362.568452:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27bb708600/0x872d29295eb47dc7 lrc: 2/0,0 mode: --/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb47dc0 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365362.568474:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27bb708600/0x872d29295eb47dc7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb47dc0 expref: 13 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365362.568483:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27bb708600/0x872d29295eb47dc7 lrc: 3/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47dc0 expref: 13 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365362.568491:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb708600, rc 0) 00000100:00100000:2.0:1787365362.568526:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+13:15090:x1874188024509056:12345-0@lo:101:mount.lustre.0 Request processed in 102us (742us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365362.568533:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00100000:1.0:1787365362.568648:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024509056:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787365362.568662:0:15090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2798114800/0x872d29295eb47dc0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47dc7 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.568672:0:15090:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2798114800/0x872d29295eb47dc0 lrc: 4/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb47dc7 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365362.568687:0:15090:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'nodemap' succeeded (0). 00010000:00010000:1.0:1787365362.568694:0:15090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2798114800/0x872d29295eb47dc0 lrc: 3/1,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47dc7 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.568701:0:15090:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2798114800/0x872d29295eb47dc0 lrc: 2/0,0 mode: CR/CR res: [0x70616d65646f6e:0x4:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47dc7 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365362.568709:0:15090:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0000-0000000000000000 10000000:01000000:1.0:1787365362.568712:0:15090:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0000 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:1.0:1787365362.568717:0:15090:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0000-0000000000000000 from 1 10000000:01000000:1.0:1787365362.568720:0:15090:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0000 (res 0x65727473756c) 00010000:00010000:1.0:1787365362.568743:0:15090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2798115000/0x872d29295eb47dce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.568750:0:15090:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2798115000/0x872d29295eb47dce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.568756:0:15090:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2798115000/0x872d29295eb47dce lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365362.568768:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024509184:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787365362.568793:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365362.568812:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27a024bd80 going to sleep for 11 seconds 00000100:00100000:2.0:1787365362.568871:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024509184 00000100:00100000:2.0:1787365362.568876:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024509184 00000100:00100000:2.0:1787365362.568904:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 33 00000100:00100000:2.0:1787365362.568910:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+13:15090:x1874188024509184:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787365362.568918:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365362.568925:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27bb709600/0x872d29295eb47dd5 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb47dce expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365362.569045:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27bb709600/0x872d29295eb47dd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb47dce expref: 14 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365362.569061:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27bb709600/0x872d29295eb47dd5 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47dce expref: 14 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365362.569068:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb709600, rc 0) 00000100:00100000:2.0:1787365362.569154:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+14:15090:x1874188024509184:12345-0@lo:101:mount.lustre.0 Request processed in 243us (359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365362.569161:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 33 00000100:00100000:1.0:1787365362.570696:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024509184:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787365362.570721:0:15090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2798115000/0x872d29295eb47dce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47dd5 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.570733:0:15090:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2798115000/0x872d29295eb47dce lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb47dd5 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787365362.574721:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:3.0:1787365362.575614:0:15090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787365362.575926:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:3.0:1787365362.575972:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:3.0:1787365362.576010:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:3.0:1787365362.576074:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:3.0:1787365362.576116:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:3.0:1787365362.576156:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:3.0:1787365362.576226:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:3.0:1787365362.576234:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:3.0:1787365362.576304:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024509312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787365362.576368:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365362.576425:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278ff1ed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787365362.576451:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024509312 00000100:00100000:1.0:1787365362.576460:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024509312 00000100:00100000:1.0:1787365362.576511:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 34 00000100:00100000:1.0:1787365362.576521:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787926c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+14:15090:x1874188024509312:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787365362.576928:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787926c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+14:15090:x1874188024509312:12345-0@lo:501:mount.lustre.0 Request processed in 407us (558us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365362.577006:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 34 00000100:00100000:3.0:1787365362.579768:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024509312:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787365362.579829:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024509440:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787365362.579901:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365362.579941:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278ff1ed80 going to sleep for 11 seconds 00000100:00100000:0.0:1787365362.580018:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024509440 00000100:00100000:0.0:1787365362.580024:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024509440 00000100:00100000:0.0:1787365362.580071:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 35 00000100:00100000:0.0:1787365362.580078:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+14:15090:x1874188024509440:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787365362.580442:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+14:15090:x1874188024509440:12345-0@lo:503:mount.lustre.0 Request processed in 363us (540us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365362.580449:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 35 00000100:00100000:3.0:1787365362.580803:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024509440:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787365362.581384:0:15090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787365362.581461:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024509568:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787365362.581507:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365362.581543:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f278fd56b40 going to sleep for 11 seconds 00000100:00100000:2.0:1787365362.581612:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024509568 00000100:00100000:2.0:1787365362.581617:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024509568 00000100:00100000:2.0:1787365362.581674:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 36 00000100:00100000:2.0:1787365362.581682:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+14:15090:x1874188024509568:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787365362.581930:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+14:15090:x1874188024509568:12345-0@lo:502:mount.lustre.0 Request processed in 249us (423us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365362.581939:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 36 00000100:00100000:1.0:1787365362.582262:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf91880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024509568:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787365362.582529:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:1.0:1787365362.582584:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:1.0:1787365362.582617:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:1.0:1787365362.582698:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:1.0:1787365362.582733:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:1.0:1787365362.582769:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:1.0:1787365362.582829:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:1.0:1787365362.582866:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:1.0:1787365362.582895:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 80 off9712 00000040:00080000:1.0:1787365362.583047:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9936 00000040:00080000:1.0:1787365362.583088:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].11, 224 off10160 00000040:00080000:1.0:1787365362.583210:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].12, 120 off10280 00000100:00100000:1.0:1787365362.583246:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024509696:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787365362.583294:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365362.583333:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27a024bb40 going to sleep for 11 seconds 00000100:00100000:2.0:1787365362.583913:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024509696 00000100:00100000:2.0:1787365362.583921:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024509696 00000100:00100000:2.0:1787365362.583981:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 37 00000100:00100000:2.0:1787365362.583990:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+14:15090:x1874188024509696:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787365362.584204:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+14:15090:x1874188024509696:12345-0@lo:502:mount.lustre.0 Request processed in 214us (908us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365362.584211:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 37 00000100:00100000:1.0:1787365362.584432:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024509696:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787365362.584516:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].13, 224 off10504 00000040:00080000:1.0:1787365362.584528:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 13 count 14 00000020:01000000:2.0:1787365362.589760:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:2.0:1787365362.589771:0:15104:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0000 (0) in 0 of lustre-ost1/ost1 00000020:00000080:2.0:1787365362.589778:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:2.0:1787365362.589781:0:15104:0:(obd_config.c:1563:class_process_config()) marker 11 (0x1) lustre-OST0000 add ost 00000020:00000080:2.0:1787365362.589788:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:2.0:1787365362.589805:0:15104:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0000 (ffff9f27bafb3370) 00000020:00000080:2.0:1787365362.589827:0:15104:0:(obd_config.c:720:class_attach_name()) OBD: dev 13 attached type obdfilter with refcount 2 00000020:00000080:2.0:1787365362.589834:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:2.0:1787365362.589908:0:15104:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f2794eb2000 from lustre-OST0000, refs=2 00080000:01000000:2.0:1787365362.589920:0:15104:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:2.0:1787365362.589932:0:15104:0:(genops.c:1385:class_connect()) connect: client lustre-OST0000-osd_UUID, cookie 0x872d29295eb47de3 00010000:00010000:3.0:1787365362.610522:0:15104:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0000_UUID-2 is initialized 00000001:00000004:3.0:1787365362.612820:0:15104:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 4294967310 00080000:10000000:3.0:1787365362.627894:0:15104:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787365362.651774:0:15104:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0000 (uuid lustre-OST0000_UUID) 00000020:01000000:0.0:1787365362.651789:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787365362.651795:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365362.651797:0:15104:0:(obd_config.c:1563:class_process_config()) marker 11 (0x2) lustre-OST0000 add ost 00000020:01000000:0.0:1787365362.651802:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x5 00000020:01000000:0.0:1787365362.651805:0:15104:0:(obd_config.c:1902:class_config_llog_handler()) SKIP #15 00000020:01000000:0.0:1787365362.651807:0:15104:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787365362.651809:0:15104:0:(obd_config.c:1928:class_config_llog_handler()) skipping 0x6 00000020:01000000:0.0:1787365362.651810:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x6 mark_flg=0x6 00000020:00000080:0.0:1787365362.651813:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365362.651814:0:15104:0:(obd_config.c:1563:class_process_config()) marker 15 (0x6) lustre sys.timeout 00000020:01000000:0.0:1787365362.651817:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787365362.651820:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365362.651821:0:15104:0:(obd_config.c:1563:class_process_config()) marker 22 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787365362.651824:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787365362.651826:0:15104:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787365362.651828:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787365362.651831:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365362.651832:0:15104:0:(obd_config.c:1563:class_process_config()) marker 22 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787365362.651834:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787365362.651837:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365362.651838:0:15104:0:(obd_config.c:1563:class_process_config()) marker 26 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787365362.651842:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787365362.651907:0:15104:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787365362.651911:0:15104:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365362.651912:0:15104:0:(obd_config.c:1563:class_process_config()) marker 26 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787365362.651916:0:15104:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 14 count 14 00000020:01000000:1.0:1787365362.652226:0:15090:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0000 gen 1-13 (rc=0) 10000000:01000000:1.0:1787365362.652252:0:15090:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0000' succeeded (0). 00010000:00010000:1.0:1787365362.652275:0:15090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2798115000/0x872d29295eb47dce lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47dd5 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.652287:0:15090:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2798115000/0x872d29295eb47dce lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 5 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47dd5 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365362.652295:0:15090:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f2794eb2000 from 1 10000000:01000000:1.0:1787365362.652298:0:15090:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787365362.652331:0:15090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2798114000/0x872d29295eb47dea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.652352:0:15090:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2798114000/0x872d29295eb47dea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.652362:0:15090:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2798114000/0x872d29295eb47dea lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365362.652385:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024509824:0@lo:101:mount.lustre.0 00000100:00100000:1.0:1787365362.652461:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365362.652502:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6b13900 going to sleep for 11 seconds 00000100:00100000:0.0:1787365362.653243:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024509824 00000100:00100000:0.0:1787365362.653250:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024509824 00000100:00100000:0.0:1787365362.653347:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 38 00000100:00100000:0.0:1787365362.653366:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+14:15090:x1874188024509824:12345-0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787365362.653380:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365362.653405:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27b6e23c00/0x872d29295eb47df1 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb47dea expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365362.653430:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27b6e23c00/0x872d29295eb47df1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb47dea expref: 15 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365362.653441:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27b6e23c00/0x872d29295eb47df1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47dea expref: 15 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365362.653448:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27b6e23c00, rc 0) 00000100:00100000:0.0:1787365362.653510:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+15:15090:x1874188024509824:12345-0@lo:101:mount.lustre.0 Request processed in 147us (1049us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365362.653518:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 38 00000100:00100000:1.0:1787365362.653604:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024509824:0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787365362.653620:0:15090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2798114000/0x872d29295eb47dea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47df1 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.653660:0:15090:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2798114000/0x872d29295eb47dea lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb47df1 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:1.0:1787365362.661791:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:1.0:1787365362.662310:0:15090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:1.0:1787365362.662580:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:1.0:1787365362.662653:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:1.0:1787365362.662726:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:1.0:1787365362.662734:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:1.0:1787365362.662814:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024509952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787365362.662874:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365362.674370:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6b13900 going to sleep for 11 seconds 00000100:00100000:2.0:1787365362.676216:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024509952 00000100:00100000:2.0:1787365362.676230:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024509952 00000100:00100000:2.0:1787365362.676294:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 39 00000100:00100000:2.0:1787365362.676305:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+15:15090:x1874188024509952:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787365362.677234:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+15:15090:x1874188024509952:12345-0@lo:501:mount.lustre.0 Request processed in 927us (14355us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365362.677245:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 39 00000100:00100000:1.0:1787365362.685271:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024509952:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787365362.685328:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024510080:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787365362.685414:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365362.685449:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6b13900 going to sleep for 11 seconds 00000100:00100000:3.0:1787365362.686233:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024510080 00000100:00100000:3.0:1787365362.686241:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024510080 00000100:00100000:3.0:1787365362.686297:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 40 00000100:00100000:3.0:1787365362.686307:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+15:15090:x1874188024510080:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787365362.686530:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+15:15090:x1874188024510080:12345-0@lo:503:mount.lustre.0 Request processed in 225us (1116us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365362.686538:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 40 00000100:00100000:1.0:1787365362.686702:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024510080:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787365362.687199:0:15090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787365362.687265:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024510208:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787365362.687311:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365362.687335:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6b13900 going to sleep for 11 seconds 00000100:00100000:3.0:1787365362.687875:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024510208 00000100:00100000:3.0:1787365362.687882:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024510208 00000100:00100000:3.0:1787365362.687926:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 41 00000100:00100000:3.0:1787365362.687934:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+15:15090:x1874188024510208:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787365362.688685:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+15:15090:x1874188024510208:12345-0@lo:502:mount.lustre.0 Request processed in 176us (798us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365362.688695:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 41 00000100:00100000:1.0:1787365362.688805:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024510208:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787365362.689069:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787365362.689790:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787365362.689860:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787365362.689897:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787365362.689928:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787365362.689973:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787365362.690028:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787365362.690061:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787365362.690099:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024510336:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787365362.690242:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365362.690327:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6b13900 going to sleep for 11 seconds 00000100:00100000:0.0:1787365362.695352:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024510336 00000100:00100000:0.0:1787365362.695366:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024510336 00000100:00100000:0.0:1787365362.695438:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 42 00000100:00100000:0.0:1787365362.695448:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+15:15090:x1874188024510336:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787365362.695728:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+15:15090:x1874188024510336:12345-0@lo:502:mount.lustre.0 Request processed in 281us (5485us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365362.695737:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 42 00000100:00100000:1.0:1787365362.697279:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024510336:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787365362.697462:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787365362.697476:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787365362.704894:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787365362.704917:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365362.704919:0:15108:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787365362.704927:0:15108:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f2794eb2000 00000020:00000080:3.0:1787365362.704929:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787365362.704936:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787365362.704938:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365362.704940:0:15108:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787365362.704942:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787365362.704945:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365362.704946:0:15108:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787365362.704949:0:15108:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f2794eb2000 00000020:00000080:3.0:1787365362.704951:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787365362.705010:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787365362.705014:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365362.705016:0:15108:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787365362.705019:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787365362.705022:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365362.705023:0:15108:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787365362.705026:0:15108:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f2794eb2000 00000020:00000080:3.0:1787365362.705028:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787365362.705063:0:15108:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787365362.705067:0:15108:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365362.705068:0:15108:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787365362.705071:0:15108:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787365362.707185:0:15090:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787365362.707224:0:15090:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787365362.707248:0:15090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2798114000/0x872d29295eb47dea lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47df1 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365362.707260:0:15090:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2798114000/0x872d29295eb47dea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47df1 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365362.707313:0:15090:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787365362.707317:0:15090:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f2794eb2000 10000000:01000000:2.0:1787365362.707320:0:15090:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f2794eb2000 10000000:01000000:2.0:1787365362.707323:0:15090:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787365362.707329:0:15090:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f2794eb2000 from 1 10000000:01000000:2.0:1787365362.707332:0:15090:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787365362.707366:0:15090:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27bb708200/0x872d29295eb47df8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365362.707374:0:15090:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27bb708200/0x872d29295eb47df8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365362.707385:0:15090:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27bb708200/0x872d29295eb47df8 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365362.707427:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbada680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024510464:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787365362.707489:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365362.707531:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024510464 00000100:00100000:2.0:1787365362.707538:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024510464 00000100:00100000:2.0:1787365362.707581:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787365362.707591:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+15:15090:x1874188024510464:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787365362.707604:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365362.707615:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27bb709000/0x872d29295eb47dff lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb47df8 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365362.707659:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27bb709000/0x872d29295eb47dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb47df8 expref: 16 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365362.707670:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27bb709000/0x872d29295eb47dff lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47df8 expref: 16 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365362.707680:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27bb709000, rc 0) 00000100:00100000:2.0:1787365362.707712:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:15090:x1874188024510464:12345-0@lo:101:mount.lustre.0 Request processed in 122us (223us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365362.707721:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 43 00000100:00100000:2.0:1787365362.707765:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27870949c0 going to sleep for 11 seconds 00000100:00100000:2.0:1787365362.707784:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbada680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024510464:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787365362.707797:0:15090:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27bb708200/0x872d29295eb47df8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47dff expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365362.707805:0:15090:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27bb708200/0x872d29295eb47df8 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb47dff expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787365362.708405:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 30 count 30 00000040:00080000:2.0:1787365362.708814:0:15090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787365362.709055:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787365362.709099:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787365362.709132:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787365362.709189:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787365362.709227:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787365362.709274:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787365362.709311:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787365362.709346:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787365362.709423:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787365362.709459:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787365362.709491:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787365362.709552:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787365362.709586:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787365362.709617:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787365362.709697:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787365362.709733:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787365362.709765:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787365362.709812:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787365362.709849:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787365362.709883:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787365362.709932:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787365362.709967:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787365362.710000:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787365362.710047:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787365362.710098:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787365362.710134:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787365362.710182:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787365362.710220:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787365362.710293:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787365362.710308:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 29 count 30 00000100:00100000:2.0:1787365362.729268:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbada680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024510592:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787365362.729370:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365362.729414:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bb9e3300 going to sleep for 11 seconds 00000100:00100000:2.0:1787365362.747704:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024510592 00000100:00100000:2.0:1787365362.747719:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024510592 00000100:00100000:2.0:1787365362.747806:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 44 00000100:00100000:2.0:1787365362.747816:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:15090:x1874188024510592:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787365362.748143:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:15090:x1874188024510592:12345-0@lo:501:mount.lustre.0 Request processed in 328us (18772us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365362.748151:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 44 00000100:00100000:1.0:1787365362.753717:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbada680 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024510592:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787365362.753788:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024510720:0@lo:503:mount.lustre.0 00000100:00100000:1.0:1787365362.753865:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365362.753911:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27a5abfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787365362.754253:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024510720 00000100:00100000:2.0:1787365362.754260:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024510720 00000100:00100000:2.0:1787365362.754313:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 45 00000100:00100000:2.0:1787365362.754322:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:15090:x1874188024510720:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787365362.754527:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:15090:x1874188024510720:12345-0@lo:503:mount.lustre.0 Request processed in 206us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365362.754535:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 45 00000100:00100000:1.0:1787365362.754792:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024510720:0@lo:503:mount.lustre.0 00000040:00080000:1.0:1787365362.755349:0:15090:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:1.0:1787365362.755424:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024510848:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787365362.755470:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365362.755505:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27a5abfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787365362.761278:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024510848 00000100:00100000:2.0:1787365362.761293:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024510848 00000100:00100000:2.0:1787365362.761348:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 46 00000100:00100000:2.0:1787365362.761358:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:15090:x1874188024510848:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787365362.761672:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:15090:x1874188024510848:12345-0@lo:502:mount.lustre.0 Request processed in 315us (6201us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365362.761680:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 46 00000100:00100000:1.0:1787365362.761690:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024510848:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787365362.762029:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:1.0:1787365362.762083:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:1.0:1787365362.762115:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:1.0:1787365362.762161:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:1.0:1787365362.763113:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:1.0:1787365362.763608:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:1.0:1787365362.763678:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:1.0:1787365362.763711:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:1.0:1787365362.763776:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:1.0:1787365362.763810:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:1.0:1787365362.763842:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:1.0:1787365362.763885:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:1.0:1787365362.763920:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:1.0:1787365362.763967:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:1.0:1787365362.764026:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:1.0:1787365362.764063:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:1.0:1787365362.764094:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:1.0:1787365362.764137:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:1.0:1787365362.764187:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:1.0:1787365362.764226:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:1.0:1787365362.764285:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:1.0:1787365362.764322:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:1.0:1787365362.764354:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:1.0:1787365362.764425:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:1.0:1787365362.764485:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:1.0:1787365362.764518:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:1.0:1787365362.764563:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:1.0:1787365362.764596:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:1.0:1787365362.764655:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:1.0:1787365362.764703:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:1.0:1787365362.764736:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:1.0:1787365362.764768:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:1.0:1787365362.764798:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:1.0:1787365362.764842:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:1.0:1787365362.764876:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:1.0:1787365362.764920:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:1.0:1787365362.764955:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:1.0:1787365362.764986:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:1.0:1787365362.765029:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:1.0:1787365362.765061:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:1.0:1787365362.765109:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024510976:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787365362.765187:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365362.765236:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27a5abfe40 going to sleep for 11 seconds 00000100:00100000:2.0:1787365362.766254:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024510976 00000100:00100000:2.0:1787365362.766264:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024510976 00000100:00100000:2.0:1787365362.766316:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 47 00000100:00100000:2.0:1787365362.766324:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:15090:x1874188024510976:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787365362.766584:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:15090:x1874188024510976:12345-0@lo:502:mount.lustre.0 Request processed in 260us (1396us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365362.766592:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 47 00000100:00100000:1.0:1787365362.768903:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024510976:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787365362.769102:0:15090:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:1.0:1787365362.769116:0:15090:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:2.0:1787365362.774856:0:15113:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0000 (typ=lwp) 00000020:00000080:2.0:1787365362.774872:0:15113:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0000 (ffff9f27bafb4d28) 00000020:00000080:2.0:1787365362.774891:0:15113:0:(obd_config.c:720:class_attach_name()) OBD: dev 14 attached type lwp with refcount 2 00000020:01000004:2.0:1787365362.776360:0:15113:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f2794eb2000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787365362.776370:0:15113:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f2794eb2000 from lustre-OST0000, refs=3 00000020:01000004:2.0:1787365362.776373:0:15113:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f2794eb2000 3 00010000:00080000:2.0:1787365362.776419:0:15113:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f268673e000@lustre-MDT0000-lwp-OST0000: add connection 192.168.203.113@tcp at head 00010000:00010000:2.0:1787365362.780813:0:15113:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0000-4 is initialized 00000020:00000080:2.0:1787365362.781877:0:15113:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0000 (uuid lustre-MDT0000-lwp-OST0000_UUID) 00000010:01000000:2.0:1787365362.781913:0:15113:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787365362.781928:0:15113:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000, cookie 0x872d29295eb47e0d 00000100:00080000:2.0:1787365362.781937:0:15113:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0000: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787365362.783037:0:15113:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0000: import ffff9f268673e000 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1787365362.783078:0:15113:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f27bbadad80 x1874188024511104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:2.0:1787365362.783115:0:15113:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0000_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787365362.783151:0:12661:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787365362.783155:0:12661:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787365362.783157:0:12661:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787365362.783161:0:12661:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787365362.783213:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874188024511104:0@lo:38:llog_process_th.0 00000100:00100000:3.0:1787365362.783282:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365362.783347:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024511104 00000100:00100000:3.0:1787365362.783354:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024511104 00000100:00100000:3.0:1787365362.783384:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787365362.783402:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874188024511104:12345-0@lo:38:llog_process_th.0 00010000:00080000:3.0:1787365362.783424:0:14408:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0000_UUID@0@lo t0 exp 0000000000000000 cur 479 last 0 00000020:00000080:3.0:1787365362.783457:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0000_UUID, cookie 0x872d29295eb47e14 00000004:00100000:3.0:1787365362.783483:0:14408:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:3.0:1787365362.783513:0:14408:0:(import.c:65:import_set_state_nolock()) ffff9f27bb900000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787365362.783562:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf91f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3309:x1874188024511104:12345-0@lo:38:llog_process_th.0 Request processed in 159us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365362.783569:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787365362.783605:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f27bbadad80 x1874188024511104/t0(0) o38->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787365372 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365362.783616:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0000: committing for last_committed 0 gen 2 00000100:00080000:3.0:1787365362.783639:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0000: connect to target with instance 2 00000100:00080000:3.0:1787365362.783646:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0000: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:3.0:1787365362.783650:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:3.0:1787365362.783653:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9f268673e000 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:3.0:1787365362.783658:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbadad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0000_UUID:3309:1874188024511104:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787365362.785129:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbad9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024511232:0@lo:400:kworker.0 00000040:00080000:3.0:1787365362.786027:0:15113:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000100:00100000:2.0:1787365362.786429:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365362.786742:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024511232 00000100:00100000:0.0:1787365362.786752:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024511232 00000100:00100000:0.0:1787365362.786949:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787365362.786959:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbadad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024511232:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365362.787017:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbadad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024511232:12345-0@lo:400:kworker.0 Request processed in 61us (589us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365362.787035:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787365362.788157:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=184649) req@ffff9f27bbad9880 x1874188024511232/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365378 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365362.788187:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbad9880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024511232:0@lo:400:kworker.0 00000020:01000000:1.0:1787365362.789885:0:15090:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:1.0:1787365362.789932:0:15090:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:1.0:1787365362.789985:0:15090:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27bb708200/0x872d29295eb47df8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47dff expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.789998:0:15090:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27bb708200/0x872d29295eb47df8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47dff expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:1.0:1787365362.790064:0:15090:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:1.0:1787365362.790066:0:15090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787365362.790068:0:15090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787365362.790069:0:15090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787365362.790070:0:15090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787365362.790071:0:15090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787365362.790073:0:15090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787365362.790075:0:15090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787365362.790076:0:15090:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787365362.790080:0:15090:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0000 0x40020002 00000020:01000004:1.0:1787365362.790083:0:15090:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:1.0:1787365362.790084:0:15090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787365362.790085:0:15090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787365362.790086:0:15090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787365362.790087:0:15090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787365362.790088:0:15090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787365362.790090:0:15090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787365362.790091:0:15090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787365362.790092:0:15090:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:1.0:1787365362.791354:0:15090:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0000 00000100:00100000:1.0:1787365362.791378:0:15090:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024511360:0@lo:253:mount.lustre.0 00000100:00100000:1.0:1787365362.791455:0:15090:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365362.791497:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024511360 00000100:00100000:1.0:1787365362.791503:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024511360 00000100:00100000:1.0:1787365362.791547:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787365362.791556:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787924050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:15090:x1874188024511360:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787365362.791582:0:14403:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 0 is ready to reconnect. 20000000:01000000:1.0:1787365362.791596:0:14403:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 00000100:00100000:1.0:1787365362.791952:0:15090:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27a5abfe40 going to sleep for 11 seconds 20000000:01000000:3.0:1787365362.841794:0:14403:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:3.0:1787365362.841814:0:14403:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0000, index=0, rc=0 20000000:01000000:0.0:1787365362.842022:0:14424:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:0.0:1787365362.842027:0:14424:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:0.0:1787365362.842049:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f27b6e23600/0x872d29295eb47e1b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365362.842067:0:14424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f27bb709400/0x872d29295eb47d88 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47d81 expref: 16 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365362.842076:0:14424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f27b6e23600/0x872d29295eb47e1b lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365362.842114:0:14424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f27bb709400/0x872d29295eb47d88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb47d81 expref: 16 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365362.842128:0:14424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f27bb709400/0x872d29295eb47d88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb47d81 expref: 16 pid: 14402 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365362.842140:0:14424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279809aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14424:1874188024511488:0@lo:104: 00000100:00100000:0.0:1787365362.842202:0:14424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365362.842252:0:14424:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b66d9480 going to sleep for 11 seconds 00000100:00100000:1.0:1787365362.842262:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024511488 00000100:00100000:1.0:1787365362.842269:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024511488 00000100:00100000:1.0:1787365362.842316:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787365362.842326:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798099880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+3:14424:x1874188024511488:12345-0@lo:104: 00010000:00010000:1.0:1787365362.842352:0:14392:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f2798115c00/0x872d29295eb47d81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb47d88 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.842413:0:14392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787365362.842420:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798099880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+3:14424:x1874188024511488:12345-0@lo:104: Request processed in 96us (217us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365362.842428:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:0.0:1787365362.842472:0:14424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279809aa00 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14424:1874188024511488:0@lo:104: 00010000:00010000:0.0:1787365362.842490:0:14424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f27b6e23600/0x872d29295eb47e1b lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365362.842575:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365362.842583:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f2798115c00/0x872d29295eb47d81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb47d88 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365362.842590:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798115c00 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:3.0:1787365362.842594:0:14396:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f2798115c00/0x872d29295eb47d81 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb47d88 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365362.842603:0:14396:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f2798115c00/0x872d29295eb47d81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb47d88 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:3.0:1787365362.842611:0:14396:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f2798115c00/0x872d29295eb47d81 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb47d88 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365362.842650:0:14396:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:3.0:1787365362.842678:0:14396:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f2798115c00/0x872d29295eb47d81 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb47d88 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365362.842684:0:14396:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:3.0:1787365362.842703:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f2798115c00/0x872d29295eb47d81 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb47d88 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365362.842709:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f2798115c00/0x872d29295eb47d81 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb47d88 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365362.842724:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365362.842726:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365362.842728:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365362.842821:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3312:1874188024511616:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787365362.842852:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365362.843255:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024511616 00000100:00100000:1.0:1787365362.843261:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024511616 00010000:00010000:1.0:1787365362.843280:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f27bb709400/0x872d29295eb47d88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb47d81 expref: 17 pid: 14402 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365362.843308:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:1.0:1787365362.843315:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+17:3312:x1874188024511616:12345-0@lo:103:ldlm_bl.0 00010000:00010000:1.0:1787365362.843326:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365362.843331:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f27bb709400/0x872d29295eb47d88 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb47d81 expref: 17 pid: 14402 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.843341:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f27bb709400/0x872d29295eb47d88 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb47d81 expref: 17 pid: 14402 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.843357:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27bb709400/0x872d29295eb47d88 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb47d81 expref: 17 pid: 14402 timeout: 580 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.843370:0:14395:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f27b6e23600/0x872d29295eb47e1b lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.843377:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27b6e23600/0x872d29295eb47e1b lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:1.0:1787365362.843413:0:14395:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001386039s 00010000:00010000:1.0:1787365362.843418:0:14395:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f27b6e23600/0x872d29295eb47e1b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.843424:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f27b6e23600/0x872d29295eb47e1b lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.843431:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f27b6e23600/0x872d29295eb47e1b lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.843437:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f27b6e23600/0x872d29295eb47e1b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.843442:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e23600 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365362.843446:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f27b6e23600/0x872d29295eb47e1b lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.843523:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f27b6e23600/0x872d29295eb47e1b lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.843541:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f27b6e23600/0x872d29295eb47e1b lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365362.843551:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787365362.843566:0:14424:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f27b6e23600/0x872d29295eb47e1b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365362.843584:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f27b6e23600/0x872d29295eb47e1b lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365362.843587:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad9880 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:3312:x1874188024511616:12345-0@lo:103:ldlm_bl.0 Request processed in 273us (734us total) trans 0 rc 0/0 00010000:00010000:2.0:1787365362.843592:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27b6e23600/0x872d29295eb47e1b lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365362.843594:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787365362.843622:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3312:1874188024511616:0@lo:103:ldlm_bl.0 00000100:00100000:3.0:1787365362.864531:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787924050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+15:15090:x1874188024511360:12345-0@lo:253:mount.lustre.0 Request processed in 72967us (73067us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365362.864546:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 48 00000100:00100000:1.0:1787365362.864721:0:15090:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15090:1874188024511360:0@lo:253:mount.lustre.0 10000000:01000000:1.0:1787365362.864736:0:15090:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0000 got index = 0 00000020:01000004:1.0:1787365362.864753:0:15090:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:1.0:1787365362.864755:0:15090:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0000 00000020:01000004:1.0:1787365362.864756:0:15090:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:1.0:1787365362.864757:0:15090:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:1.0:1787365362.864758:0:15090:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:1.0:1787365362.864759:0:15090:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:1.0:1787365362.864761:0:15090:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:1.0:1787365362.864762:0:15090:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:1.0:1787365362.864763:0:15090:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:1.0:1787365362.864777:0:15090:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0000: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:1.0:1787365362.871864:0:15090:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:1.0:1787365362.872037:0:15090:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:1.0:1787365362.873335:0:15090:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:1.0:1787365362.873967:0:15090:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:1.0:1787365362.874134:0:15090:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:1.0:1787365362.874804:0:15090:0:(osd_index.c:2103:osd_index_try()) lustre-OST0000: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787365362.877732:0:15090:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:1.0:1787365362.977991:0:15090:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0000: recovery is over 00100000:10000000:1.0:1787365362.978003:0:15090:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0000-osd: start master thread 00000020:01000004:2.0:1787365362.978201:0:15090:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787365362.978288:0:15090:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787365362.978309:0:15090:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=48 00000080:00000004:2.0:1787365362.978343:0:15090:0:(super25.c:182:lustre_fill_super()) lustre-ost1/ost1: Mount complete 00010000:00010000:3.0:1787365363.380139:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787365364.210689:0:14405:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787365364.210698:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f27b63ba000 from 7 10000000:01000000:1.0:1787365364.210704:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:3.0:1787365364.210941:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2788f45600/0x872d29295eb47e22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365364.210954:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2788f45600/0x872d29295eb47e22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365364.210967:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2788f45600/0x872d29295eb47e22 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365364.210991:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024511744:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787365364.211067:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365364.211193:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024511744 00000100:00100000:0.0:1787365364.211200:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024511744 00000100:00100000:0.0:1787365364.211252:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 49 00000100:00100000:0.0:1787365364.211262:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+15:14405:x1874188024511744:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787365364.211280:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365364.211293:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27b6e22200/0x872d29295eb47e29 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb47e22 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365364.211317:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27b6e22200/0x872d29295eb47e29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb47e22 expref: 16 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365364.211327:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27b6e22200/0x872d29295eb47e29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47e22 expref: 16 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365364.211335:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27b6e22200, rc 0) 00000100:00100000:0.0:1787365364.211373:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:14405:x1874188024511744:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 113us (306us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365364.211389:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 49 00000100:00100000:3.0:1787365364.211520:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b690b9c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365364.211541:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb409880 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024511744:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787365364.211555:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2788f45600/0x872d29295eb47e22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47e29 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365364.211563:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2788f45600/0x872d29295eb47e22 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb47e29 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365364.211611:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf91c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024511872:0@lo:256:ll_cfg_requeue.0 00000100:00100000:3.0:1787365364.211669:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365364.211695:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b690b9c0 going to sleep for 11 seconds 00000100:00100000:1.0:1787365364.211709:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024511872 00000100:00100000:1.0:1787365364.211713:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024511872 00000100:00100000:1.0:1787365364.211745:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 50 00000100:00100000:1.0:1787365364.211762:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:14405:x1874188024511872:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:1.0:1787365364.211776:0:14403:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:1.0:1787365364.211793:0:14403:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:1.0:1787365364.211797:0:14403:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 7 00000100:00100000:1.0:1787365364.211895:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:14405:x1874188024511872:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 143us (224us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365364.211903:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 50 00000100:00100000:0.0:1787365364.211943:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf91c00 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024511872:0@lo:256:ll_cfg_requeue.0 10000000:01000000:0.0:1787365364.212001:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:0.0:1787365364.212017:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2788f45600/0x872d29295eb47e22 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47e29 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365364.212025:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2788f45600/0x872d29295eb47e22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47e29 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365364.414715:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365365.429819:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365366.451842:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365367.474789:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:2.0:1787365368.180573:0:12661:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787365368.180581:0:12661:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:2.0:1787365368.180583:0:12661:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787365368.180586:0:12661:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:2.0:1787365368.180675:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024512128:0@lo:400:kworker.0 00000100:00100000:2.0:1787365368.180742:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365368.180813:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:2.0:1787365368.180819:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024512256:0@lo:400:kworker.0 00000100:00100000:2.0:1787365368.180845:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365368.180884:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024512128 00000100:00100000:2.0:1787365368.180891:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024512128 00000100:00100000:2.0:1787365368.180927:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024512256 00000100:00100000:2.0:1787365368.180931:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024512256 00000100:00100000:1.0:1787365368.181005:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787365368.181021:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3312:1874188024512000:0@lo:400:kworker.0 00000100:00100000:1.0:1787365368.181053:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365368.181457:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787365368.181470:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024512128:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365368.181536:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbadbb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024512128:12345-0@lo:400:kworker.0 Request processed in 69us (794us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365368.181544:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:3.0:1787365368.181610:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bbad9f80 x1874188024512128/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365368.181642:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbad9f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024512128:0@lo:400:kworker.0 00000100:00100000:2.0:1787365368.195231:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787365368.195245:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024512256:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365368.195402:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad8000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024512256:12345-0@lo:400:kworker.0 Request processed in 97us (14490us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365368.195411:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00080000:2.0:1787365368.195457:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bbad8380 x1874188024512256/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365384 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365368.195472:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbad8380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024512256:0@lo:400:kworker.0 00000100:00080000:0.0:1787365368.203270:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365368.205401:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024512000 00000100:00100000:0.0:1787365368.205414:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024512000 00000100:00100000:0.0:1787365368.205475:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 51 00000100:00100000:0.0:1787365368.205495:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:3312:x1874188024512000:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365368.205575:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:3312:x1874188024512000:12345-0@lo:400:kworker.0 Request processed in 91us (24520us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365368.205605:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 51 00000100:00100000:1.0:1787365368.205904:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbada680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3312:1874188024512000:0@lo:400:kworker.0 00010000:00010000:3.0:1787365368.498927:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365369.531443:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787365370.151357:0:15456:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787365370.550650:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365371.571977:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787365372.019348:0:14442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:3.0:1787365372.597355:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787365373.299480:0:12661:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787365373.299486:0:12661:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00080000:3.0:1787365373.299490:0:12661:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level CONNECTING/4 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787365373.299493:0:12661:0:(pinger.c:247:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: not pinging (in recovery or recovery disabled: CONNECTING) 00000100:00100000:3.0:1787365373.299547:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3312:1874188024512384:0@lo:400:kworker.0 00000100:00100000:3.0:1787365373.299617:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365373.299691:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:3.0:1787365373.299697:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024512512:0@lo:400:kworker.0 00000100:00100000:3.0:1787365373.299725:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365373.299755:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024512640:0@lo:400:kworker.0 00000100:00100000:3.0:1787365373.299792:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365373.299826:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024512384 00000100:00100000:3.0:1787365373.299833:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024512384 00000100:00100000:3.0:1787365373.299889:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787365373.299898:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:3312:x1874188024512384:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365373.300351:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:3312:x1874188024512384:12345-0@lo:400:kworker.0 Request processed in 452us (733us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365373.300360:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 52 00000100:00100000:3.0:1787365373.300393:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024512512 00000100:00100000:3.0:1787365373.300397:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024512512 00000100:00100000:3.0:1787365373.300419:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024512640 00000100:00100000:3.0:1787365373.300422:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024512640 00000100:00100000:3.0:1787365373.300446:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787365373.300452:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024512512:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365373.300485:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf93800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024512512:12345-0@lo:400:kworker.0 Request processed in 33us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365373.300502:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787365373.300513:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787365373.300519:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024512640:12345-0@lo:400:kworker.0 00010000:00080000:1.0:1787365373.300644:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27baf90380 x1874188024512512/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365373.300658:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024512512:0@lo:400:kworker.0 00000100:00100000:1.0:1787365373.300669:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf91500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3312:1874188024512384:0@lo:400:kworker.0 00000100:00100000:3.0:1787365373.300838:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf92300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024512640:12345-0@lo:400:kworker.0 Request processed in 317us (1043us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365373.300845:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00080000:3.0:1787365373.300902:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:1.0:1787365373.301679:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27baf90e00 x1874188024512640/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365389 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365373.301693:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf90e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024512640:0@lo:400:kworker.0 00010000:00010000:3.0:1787365373.622221:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365374.005459:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787365359/real 1787365359] req@ffff9f27bbadb100 x1874188024508416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787365374 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365374.005489:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f27bbadb100 x1874188024508416/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787365374 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365374.005499:0:3309:0:(client.c:2503:ptlrpc_expire_one_request()) @@@ Request sent has timed out for slow reply: [sent 1787365359/real 1787365359] req@ffff9f27bbadb480 x1874188024508544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787365374 ref 1 fl Rpc:XNQr/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365374.005510:0:3309:0:(client.c:2534:ptlrpc_expire_one_request()) @@@ err -110, sent_state=CONNECTING (now=CONNECTING) req@ffff9f27bbadb480 x1874188024508544/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 1 dl 1787365374 ref 1 fl Rpc:XNQU/200/ffffffff rc 0/-1 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:2.0:1787365374.005529:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9f27bb87d800 lustre-OST0000_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787365374.005558:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0000_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787365374.005579:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbadb100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024508416:0@lo:8:kworker.0 00000100:00080000:2.0:1787365374.005585:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9f27bbae3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787365374.005591:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-110) 00000100:00100000:2.0:1787365374.005594:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbadb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024508544:0@lo:8:kworker.0 00000100:00080000:1.0:1787365374.006886:0:12661:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0000_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787365374.006891:0:12661:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0000_UUID: starting recovery 00000100:00080000:1.0:1787365374.006894:0:12661:0:(import.c:65:import_set_state_nolock()) ffff9f27bb87d800 lustre-OST0000_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787365374.006900:0:12661:0:(import.c:510:import_select_connection()) lustre-OST0000-osc-MDT0000: connect to NID 0@lo last attempt 477 00000100:00080000:1.0:1787365374.006912:0:12661:0:(import.c:589:import_select_connection()) lustre-OST0000-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787365374.006919:0:12661:0:(import.c:624:import_select_connection()) lustre-OST0000-osc-MDT0000: import ffff9f27bb87d800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1787365374.006939:0:12661:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f27bb40b100 x1874188024512896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00080000:1.0:1787365374.006961:0:12661:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 1 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:1.0:1787365374.006964:0:12661:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:1.0:1787365374.006966:0:12661:0:(import.c:65:import_set_state_nolock()) ffff9f27bbae3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:1.0:1787365374.006969:0:12661:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 477 00000100:00080000:1.0:1787365374.006982:0:12661:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 10s 00000100:00080000:1.0:1787365374.006986:0:12661:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f27bbae3800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:1.0:1787365374.006999:0:12661:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f27bb409180 x1874188024513024/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:1.0:1787365374.007067:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024513152:0@lo:400:kworker.0 00000100:00100000:1.0:1787365374.007128:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365374.007188:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787365374.007194:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024513280:0@lo:400:kworker.0 00000100:00100000:1.0:1787365374.007215:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365374.007250:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024513152 00000100:00100000:1.0:1787365374.007256:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024513152 00000100:00100000:1.0:1787365374.007291:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024513280 00000100:00100000:1.0:1787365374.007293:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024513280 00000100:00100000:1.0:1787365374.007306:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787365374.007324:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024513152:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365374.007373:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb408700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024513152:12345-0@lo:400:kworker.0 Request processed in 60us (245us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365374.007381:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:1.0:1787365374.007395:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787365374.007401:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb40aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024513280:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365374.007426:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb40aa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024513280:12345-0@lo:400:kworker.0 Request processed in 26us (211us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365374.007432:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00010000:00080000:1.0:1787365374.007462:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bb408a80 x1874188024513280/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365374.007475:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024513280:0@lo:400:kworker.0 00010000:00080000:1.0:1787365374.007495:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bb408e00 x1874188024513152/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365390 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:1.0:1787365374.007503:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb408e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024513152:0@lo:400:kworker.0 00000100:00100000:3.0:1787365374.007718:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb40ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3311:1874188024512768:0@lo:400:kworker.0 00000100:00100000:3.0:1787365374.007748:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365374.007990:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb40b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024512896:0@lo:8:kworker.0 00000100:00100000:0.0:1787365374.008030:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365374.008056:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024513024:0@lo:8:kworker.0 00000100:00100000:0.0:1787365374.008076:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365374.008155:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024512896 00000100:00100000:2.0:1787365374.008159:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024512896 00000100:00100000:2.0:1787365374.008186:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024513024 00000100:00100000:2.0:1787365374.008189:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024513024 00000100:00100000:2.0:1787365374.008199:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787365374.008204:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279809aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1874188024512896:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787365374.008227:0:15091:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 491 last 0 00000020:00000080:2.0:1787365374.008253:0:15091:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x872d29295eb47e30 00002000:00100000:2.0:1787365374.008268:0:15091:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli lustre-MDT0000-mdtlov_UUID/ffff9f268673c800 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392e ocd_grant: 0 ocd_index: 0 ocd_group 0 00002000:00080000:2.0:1787365374.008271:0:15091:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0000: Received MDS connection for group 0 00002000:00100000:2.0:1787365374.008274:0:15091:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0000: cli does not support OBD_CONNECT_CKSUM 00002000:00080000:2.0:1787365374.008608:0:15091:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:2.0:1787365374.008660:0:15091:0:(import.c:65:import_set_state_nolock()) ffff9f268673c000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787365374.008711:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279809aa00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1874188024512896:12345-0@lo:8:kworker.0 Request processed in 506us (679us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365374.008717:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787365374.008733:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787365374.008737:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279809b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1874188024513024:12345-0@lo:8:kworker.0 00010000:00020000:2.0:1787365374.008747:0:15091:0:(ldlm_lib.c:1190:target_handle_connect()) lustre-OST0001: not available for connect from 0@lo (no target). If you are running an HA pair check that the target is mounted on the other server. 00000100:00100000:2.0:1787365374.008770:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279809b480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1874188024513024:12345-0@lo:8:kworker.0 Request processed in 31us (693us total) trans 0 rc -19/-19 00000100:00100000:2.0:1787365374.008775:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00010000:00080000:2.0:1787365374.008829:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bb40b100 x1874188024512896/t0(0) o8->lustre-OST0000-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787365394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365374.008838:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787365374.008845:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0000-osc-MDT0000: connect to target with instance 2 00000100:00080000:2.0:1787365374.009118:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0000-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:2.0:1787365374.009126:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0000_UUID 00000100:00080000:2.0:1787365374.009129:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9f27bb87d800 lustre-OST0000_UUID: changing import state from CONNECTING to FULL 00000004:00080000:2.0:1787365374.009144:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:2.0:1787365374.009150:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb40b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024512896:0@lo:8:kworker.0 00000100:00080000:2.0:1787365374.009167:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9f27bbae3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787365374.009171:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-19) 00000100:00100000:2.0:1787365374.009174:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024513024:0@lo:8:kworker.0 00000004:00080000:2.0:1787365374.009227:0:14431:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: going to cleanup orphans since [0x240000400:0x5:0x0] 00000100:00100000:2.0:1787365374.009243:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbadb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14431:1874188024513536:0@lo:5:osp-pre-0-0.0 00000100:00100000:2.0:1787365374.009271:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365374.009286:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bc726900 going to sleep for 11 seconds 00000100:00100000:2.0:1787365374.009298:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbadb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024513408:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787365374.009332:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365374.009364:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024513536 00000100:00100000:2.0:1787365374.009368:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024513536 00000100:00100000:2.0:1787365374.009400:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787365374.009406:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14431:x1874188024513536:12345-0@lo:5:osp-pre-0-0.0 00000100:00080000:3.0:1787365374.010094:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787365374.011508:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024512768 00000100:00100000:1.0:1787365374.011519:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024512768 00000100:00100000:1.0:1787365374.011572:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 53 00000100:00100000:1.0:1787365374.011581:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:3311:x1874188024512768:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365374.011694:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:3311:x1874188024512768:12345-0@lo:400:kworker.0 Request processed in 114us (3944us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365374.011700:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 53 00000004:00080000:1.0:1787365374.011733:0:14430:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000100:00100000:0.0:1787365374.012089:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb40ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3311:1874188024512768:0@lo:400:kworker.0 00000100:00100000:0.0:1787365374.012142:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024513408 00000100:00100000:0.0:1787365374.012146:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024513408 00000100:00100000:0.0:1787365374.012171:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787365374.012177:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874188024513408:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787365374.012201:0:15095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787365374.012244:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad9500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874188024513408:12345-0@lo:13:osp-pre-0-0.0 Request processed in 66us (2911us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365374.012250:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00010000:00080000:0.0:1787365374.012280:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bbadb480 x1874188024513408/t0(0) o13->lustre-OST0000-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365390 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-0-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:0.0:1787365374.012297:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbadb480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024513408:0@lo:13:osp-pre-0-0.0 00000004:00080000:1.0:1787365374.012534:0:14430:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0000-osc-MDT0000: add commit cb at 491176908116ns, next at 0ns, rc = 0 00002000:00080000:2.0:1787365374.017334:0:15091:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0000: adding sequence 0x240000400 00002000:00080000:2.0:1787365374.017346:0:15091:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -28 00002000:02000040:2.0:1787365374.017351:0:15091:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0000: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x240000400:6 to 0x240000400:33) 00002000:00010000:3.0:1787365374.044477:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365374.044489:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038e4a6cd/0x872d29295eb47e37 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.044506:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=491s v=(0 0) 00010000:00010000:3.0:1787365374.044510:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365374.044516:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038e4a6cd/0x872d29295eb47e37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.044532:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038e4a6cd/0x872d29295eb47e37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.044543:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038e4a6cd/0x872d29295eb47e37 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.044563:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038e4a6cd/0x872d29295eb47e37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.044583:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787365374.044597:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365374.044603:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038e4a6cd/0x872d29295eb47e37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.044611:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45c00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365374.044617:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038e4a6cd/0x872d29295eb47e37 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.044653:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038e4a6cd/0x872d29295eb47e37 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.044672:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038e4a6cd/0x872d29295eb47e37 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.044679:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038e4a6cd/0x872d29295eb47e37 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.044696:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365374.044698:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365374.044700:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787365374.045210:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365374.045225:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47e3e lrc: 3/0,1 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.045236:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=491s v=(0 0) 00010000:00010000:3.0:1787365374.045239:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365374.045244:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47e3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.045255:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47e3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.045264:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47e3e lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.045271:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47e3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.045287:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787365374.045297:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365374.045301:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47e3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.045308:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44800 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365374.045324:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47e3e lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.045334:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47e3e lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.045353:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47e3e lrc: 1/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.045361:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47e3e lrc: 0/0,0 mode: --/PW res: [0x240000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.045375:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365374.045377:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365374.045378:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787365374.045836:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365374.045843:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fb34120/0x872d29295eb47e45 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.045852:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=491s v=(0 0) 00010000:00010000:3.0:1787365374.045856:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365374.045860:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fb34120/0x872d29295eb47e45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.045871:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fb34120/0x872d29295eb47e45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.045879:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fb34120/0x872d29295eb47e45 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.045886:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fb34120/0x872d29295eb47e45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.045912:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787365374.045922:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365374.045927:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fb34120/0x872d29295eb47e45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.045934:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45e00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365374.045938:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fb34120/0x872d29295eb47e45 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.045946:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fb34120/0x872d29295eb47e45 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.045958:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fb34120/0x872d29295eb47e45 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.045965:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fb34120/0x872d29295eb47e45 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.045978:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365374.045980:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365374.045981:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787365374.049732:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365374.049745:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f755e4f/0x872d29295eb47e4c lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.049761:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=491s v=(0 0) 00010000:00010000:3.0:1787365374.049772:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365374.049779:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000009f755e4f/0x872d29295eb47e4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.060522:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000009f755e4f/0x872d29295eb47e4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.060538:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000009f755e4f/0x872d29295eb47e4c lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.060546:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000009f755e4f/0x872d29295eb47e4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.060570:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787365374.061082:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365374.061090:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb8b04a4/0x872d29295eb47e53 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.061102:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=491s v=(0 0) 00010000:00010000:3.0:1787365374.061106:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365374.061111:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cb8b04a4/0x872d29295eb47e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.061121:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cb8b04a4/0x872d29295eb47e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.061129:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cb8b04a4/0x872d29295eb47e53 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.061142:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cb8b04a4/0x872d29295eb47e53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.061156:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787365374.061166:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787365374.061172:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000009f755e4f/0x872d29295eb47e4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.061180:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45200 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365374.061185:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000009f755e4f/0x872d29295eb47e4c lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.061194:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000009f755e4f/0x872d29295eb47e4c lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.061208:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000009f755e4f/0x872d29295eb47e4c lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.061216:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000009f755e4f/0x872d29295eb47e4c lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365374.061227:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365374.061232:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365374.061235:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365374.061236:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cb8b04a4/0x872d29295eb47e53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.061238:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365374.061248:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45000 already unused, calling callback (ffffffffc1672420) 00010000:00010000:0.0:1787365374.061253:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb8b04a4/0x872d29295eb47e53 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365374.061269:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cb8b04a4/0x872d29295eb47e53 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365374.061286:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cb8b04a4/0x872d29295eb47e53 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365374.061295:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cb8b04a4/0x872d29295eb47e53 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365374.061325:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365374.061327:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365374.061329:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787365374.061727:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365374.061740:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b43ebbdf/0x872d29295eb47e5a lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.061750:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=491s v=(0 0) 00010000:00010000:3.0:1787365374.061753:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365374.061758:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000b43ebbdf/0x872d29295eb47e5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.061768:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000b43ebbdf/0x872d29295eb47e5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.061777:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000b43ebbdf/0x872d29295eb47e5a lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.061783:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000b43ebbdf/0x872d29295eb47e5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.061806:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787365374.061891:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365374.061897:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000b43ebbdf/0x872d29295eb47e5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365374.061905:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44000 already unused, calling callback (ffffffffc1672420) 00010000:00010000:0.0:1787365374.061910:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000b43ebbdf/0x872d29295eb47e5a lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365374.061919:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000b43ebbdf/0x872d29295eb47e5a lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365374.061933:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000b43ebbdf/0x872d29295eb47e5a lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365374.061961:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000b43ebbdf/0x872d29295eb47e5a lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365374.061979:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365374.061982:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365374.061984:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787365374.063288:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365374.063299:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fb34120/0x872d29295eb47e61 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.063323:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=491s v=(0 0) 00010000:00010000:3.0:1787365374.063327:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365374.063333:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000004fb34120/0x872d29295eb47e61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.063344:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000004fb34120/0x872d29295eb47e61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.063361:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000004fb34120/0x872d29295eb47e61 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.063369:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000004fb34120/0x872d29295eb47e61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.063390:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787365374.063904:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365374.063912:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47e68 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.063921:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=491s v=(0 0) 00010000:00010000:3.0:1787365374.063925:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365374.063929:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47e68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.063939:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47e68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.063947:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47e68 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.063954:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47e68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.063986:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787365374.064648:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787365374.064657:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000004fb34120/0x872d29295eb47e61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365374.064667:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45e00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:0.0:1787365374.064672:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000004fb34120/0x872d29295eb47e61 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365374.064682:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000004fb34120/0x872d29295eb47e61 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365374.064699:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000004fb34120/0x872d29295eb47e61 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365374.064707:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000004fb34120/0x872d29295eb47e61 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365374.064724:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365374.064728:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47e68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365374.064742:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44800 already unused, calling callback (ffffffffc1672420) 00010000:00010000:0.0:1787365374.064746:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47e68 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365374.064755:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47e68 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.064761:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365374.064766:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47e68 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365374.064776:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001adbab52/0x872d29295eb47e68 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365374.064792:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365374.064794:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365374.064795:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787365374.068476:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365374.068490:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038e4a6cd/0x872d29295eb47e6f lrc: 3/0,1 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.068508:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=491s v=(0 0) 00010000:00010000:3.0:1787365374.068513:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365374.068519:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000038e4a6cd/0x872d29295eb47e6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.068533:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000038e4a6cd/0x872d29295eb47e6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.068544:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000038e4a6cd/0x872d29295eb47e6f lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.068552:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000038e4a6cd/0x872d29295eb47e6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.068678:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:3.0:1787365374.070387:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365374.070398:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f54c012a/0x872d29295eb47e76 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.070413:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=491s v=(0 0) 00010000:00010000:3.0:1787365374.070425:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365374.070432:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f54c012a/0x872d29295eb47e76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.070445:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f54c012a/0x872d29295eb47e76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.070455:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f54c012a/0x872d29295eb47e76 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.070462:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f54c012a/0x872d29295eb47e76 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.071966:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787365374.071979:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000038e4a6cd/0x872d29295eb47e6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.071992:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45c00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365374.071998:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000038e4a6cd/0x872d29295eb47e6f lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.072009:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000038e4a6cd/0x872d29295eb47e6f lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.072033:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000038e4a6cd/0x872d29295eb47e6f lrc: 1/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.072057:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000038e4a6cd/0x872d29295eb47e6f lrc: 0/0,0 mode: --/PW res: [0x240000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.072083:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365374.072087:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f54c012a/0x872d29295eb47e76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.072098:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44600 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365374.072102:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f54c012a/0x872d29295eb47e76 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.072110:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f54c012a/0x872d29295eb47e76 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.072121:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f54c012a/0x872d29295eb47e76 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.072128:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.072130:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.072131:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365374.072293:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787365374.072301:0:15091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f54c012a/0x872d29295eb47e76 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787365374.073046:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365374.073054:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bc51448/0x872d29295eb47e7d lrc: 3/0,1 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.073065:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=491s v=(0 0) 00010000:00010000:3.0:1787365374.073069:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365374.073075:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000002bc51448/0x872d29295eb47e7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.073088:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000002bc51448/0x872d29295eb47e7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.073105:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000002bc51448/0x872d29295eb47e7d lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.073113:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000002bc51448/0x872d29295eb47e7d lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.073452:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365374.073459:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000002bc51448/0x872d29295eb47e7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.073467:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44e00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365374.073477:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000002bc51448/0x872d29295eb47e7d lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.073485:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000002bc51448/0x872d29295eb47e7d lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.073499:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000002bc51448/0x872d29295eb47e7d lrc: 2/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.073508:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.073509:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.073511:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365374.074062:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787365374.074070:0:15091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000002bc51448/0x872d29295eb47e7d lrc: 0/0,0 mode: --/PW res: [0x240000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787365374.074643:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365374.074652:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb47e84 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.074663:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=491s v=(0 0) 00010000:00010000:3.0:1787365374.074667:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365374.074673:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb47e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.074685:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb47e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.074693:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb47e84 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.074711:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb47e84 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.075033:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365374.075041:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb47e84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.075051:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45a00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365374.075055:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb47e84 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.075064:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb47e84 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.075078:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb47e84 lrc: 2/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.075087:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.075095:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.075097:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365374.075158:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787365374.075164:0:15091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000e06c505d/0x872d29295eb47e84 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:3.0:1787365374.075594:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365374.075600:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cccb3299/0x872d29295eb47e8b lrc: 3/0,1 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.075610:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=491s v=(0 0) 00010000:00010000:3.0:1787365374.075614:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365374.075619:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000cccb3299/0x872d29295eb47e8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.075646:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000cccb3299/0x872d29295eb47e8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.075654:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000cccb3299/0x872d29295eb47e8b lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.075660:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000cccb3299/0x872d29295eb47e8b lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.075711:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365374.075716:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000cccb3299/0x872d29295eb47e8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.075724:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45400 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365374.075727:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000cccb3299/0x872d29295eb47e8b lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.075735:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000cccb3299/0x872d29295eb47e8b lrc: 4/0,0 mode: PW/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.075746:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000cccb3299/0x872d29295eb47e8b lrc: 2/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.075755:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.075758:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.075760:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365374.076014:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:3.0:1787365374.076019:0:15091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000cccb3299/0x872d29295eb47e8b lrc: 0/0,0 mode: --/PW res: [0x240000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.076344:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:3.0:1787365374.076667:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:3.0:1787365374.076673:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c225080/0x872d29295eb47e92 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.076683:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=491s v=(0 0) 00010000:00010000:3.0:1787365374.076687:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365374.076691:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001c225080/0x872d29295eb47e92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.076701:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001c225080/0x872d29295eb47e92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.076711:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001c225080/0x872d29295eb47e92 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.076719:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001c225080/0x872d29295eb47e92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.076738:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787365374.076749:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365374.076755:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001c225080/0x872d29295eb47e92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.076768:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44c00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365374.076773:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001c225080/0x872d29295eb47e92 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.076782:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001c225080/0x872d29295eb47e92 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.076963:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001c225080/0x872d29295eb47e92 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.076971:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001c225080/0x872d29295eb47e92 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.076985:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365374.076987:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365374.076989:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787365374.079004:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0000-osc-MDT0000: 1 committed 00002000:00010000:2.0:1787365374.082848:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787365374.082863:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd228749/0x872d29295eb47e99 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.082880:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=491s v=(0 0) 00010000:00010000:2.0:1787365374.082885:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365374.082892:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000fd228749/0x872d29295eb47e99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.082908:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000fd228749/0x872d29295eb47e99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.082919:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000fd228749/0x872d29295eb47e99 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.082927:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000fd228749/0x872d29295eb47e99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.082954:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787365374.083008:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365374.083015:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000fd228749/0x872d29295eb47e99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.083024:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709400 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365374.083029:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd228749/0x872d29295eb47e99 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.083051:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000fd228749/0x872d29295eb47e99 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.083069:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000fd228749/0x872d29295eb47e99 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.083078:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000fd228749/0x872d29295eb47e99 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.083094:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.083096:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.083098:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787365374.083483:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787365374.083489:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c470320c/0x872d29295eb47ea0 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.083499:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=491s v=(0 0) 00010000:00010000:2.0:1787365374.083502:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365374.083507:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000c470320c/0x872d29295eb47ea0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.083527:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000c470320c/0x872d29295eb47ea0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.083535:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000c470320c/0x872d29295eb47ea0 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.083541:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000c470320c/0x872d29295eb47ea0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.083556:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787365374.083977:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787365374.083983:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000497c03f3/0x872d29295eb47ea7 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.083991:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=491s v=(0 0) 00010000:00010000:2.0:1787365374.083995:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365374.083999:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000497c03f3/0x872d29295eb47ea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.084008:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000497c03f3/0x872d29295eb47ea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.084015:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000497c03f3/0x872d29295eb47ea7 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.084178:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365374.084185:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000c470320c/0x872d29295eb47ea0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.084193:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708400 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365374.084197:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000c470320c/0x872d29295eb47ea0 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.084206:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000c470320c/0x872d29295eb47ea0 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.084226:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000c470320c/0x872d29295eb47ea0 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.084234:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000c470320c/0x872d29295eb47ea0 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.084247:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365374.084249:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365374.084251:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365374.085137:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000497c03f3/0x872d29295eb47ea7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.085161:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787365374.085352:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365374.085359:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000497c03f3/0x872d29295eb47ea7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.085367:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709e00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365374.085371:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000497c03f3/0x872d29295eb47ea7 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.085380:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000497c03f3/0x872d29295eb47ea7 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.085395:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000497c03f3/0x872d29295eb47ea7 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.085414:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000497c03f3/0x872d29295eb47ea7 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.085432:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.085434:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.085436:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787365374.085904:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787365374.085911:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9bb8f4f/0x872d29295eb47eae lrc: 3/0,1 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.085922:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=491s v=(0 0) 00010000:00010000:2.0:1787365374.085926:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365374.085932:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000f9bb8f4f/0x872d29295eb47eae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.085943:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000f9bb8f4f/0x872d29295eb47eae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.085952:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000f9bb8f4f/0x872d29295eb47eae lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.085960:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000f9bb8f4f/0x872d29295eb47eae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.085981:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787365374.086395:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787365374.086401:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de749ea1/0x872d29295eb47eb5 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.086416:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=491s v=(0 0) 00010000:00010000:2.0:1787365374.086420:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365374.086424:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000de749ea1/0x872d29295eb47eb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.086434:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000de749ea1/0x872d29295eb47eb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.086443:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000de749ea1/0x872d29295eb47eb5 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.086451:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000de749ea1/0x872d29295eb47eb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.086472:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787365374.086648:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787365374.086654:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000f9bb8f4f/0x872d29295eb47eae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.086663:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709800 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365374.086667:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9bb8f4f/0x872d29295eb47eae lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.086675:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000f9bb8f4f/0x872d29295eb47eae lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.086688:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000f9bb8f4f/0x872d29295eb47eae lrc: 1/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.086696:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000f9bb8f4f/0x872d29295eb47eae lrc: 0/0,0 mode: --/PW res: [0x240000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.086711:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365374.086715:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000de749ea1/0x872d29295eb47eb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.086726:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708800 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365374.086729:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000de749ea1/0x872d29295eb47eb5 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.086737:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000de749ea1/0x872d29295eb47eb5 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.086747:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000de749ea1/0x872d29295eb47eb5 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.086754:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000de749ea1/0x872d29295eb47eb5 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.086767:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.086769:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.086770:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787365374.086883:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787365374.086888:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e796b9/0x872d29295eb47ebc lrc: 3/0,1 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.086897:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=491s v=(0 0) 00010000:00010000:2.0:1787365374.086901:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365374.086905:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000008e796b9/0x872d29295eb47ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.086914:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000008e796b9/0x872d29295eb47ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.086934:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000008e796b9/0x872d29295eb47ebc lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.086941:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000008e796b9/0x872d29295eb47ebc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.086960:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787365374.087027:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365374.087032:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000008e796b9/0x872d29295eb47ebc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.087039:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708c00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365374.087042:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e796b9/0x872d29295eb47ebc lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.087050:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000008e796b9/0x872d29295eb47ebc lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.087067:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000008e796b9/0x872d29295eb47ebc lrc: 1/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.087075:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000008e796b9/0x872d29295eb47ebc lrc: 0/0,0 mode: --/PW res: [0x240000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.087088:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.087090:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.087092:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365374.087469:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787365374.087524:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787365374.087530:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044c7ae50/0x872d29295eb47ec3 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.087539:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=491s v=(0 0) 00010000:00010000:2.0:1787365374.087542:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365374.087546:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000044c7ae50/0x872d29295eb47ec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.087555:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000044c7ae50/0x872d29295eb47ec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.087564:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000044c7ae50/0x872d29295eb47ec3 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.087572:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000044c7ae50/0x872d29295eb47ec3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.087604:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787365374.087678:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365374.087683:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000044c7ae50/0x872d29295eb47ec3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.087690:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709a00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365374.087694:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000044c7ae50/0x872d29295eb47ec3 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.087701:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000044c7ae50/0x872d29295eb47ec3 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.087713:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000044c7ae50/0x872d29295eb47ec3 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.087720:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000044c7ae50/0x872d29295eb47ec3 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.087743:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.087745:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.087747:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787365374.089534:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787365374.089548:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000510d584e/0x872d29295eb47eca lrc: 3/0,1 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.089563:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=491s v=(0 0) 00010000:00010000:2.0:1787365374.089567:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365374.089573:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000510d584e/0x872d29295eb47eca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.089586:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000510d584e/0x872d29295eb47eca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.089596:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000510d584e/0x872d29295eb47eca lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.089603:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000510d584e/0x872d29295eb47eca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.089693:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787365374.090195:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787365374.090202:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002bf0aef/0x872d29295eb47ed1 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.090212:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=491s v=(0 0) 00010000:00010000:2.0:1787365374.090222:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365374.090226:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000002bf0aef/0x872d29295eb47ed1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.090237:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000002bf0aef/0x872d29295eb47ed1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.090245:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000002bf0aef/0x872d29295eb47ed1 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.090252:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000002bf0aef/0x872d29295eb47ed1 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.092398:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787365374.092412:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000510d584e/0x872d29295eb47eca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.092426:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708e00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365374.092431:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000510d584e/0x872d29295eb47eca lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.092442:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000510d584e/0x872d29295eb47eca lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.092463:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000510d584e/0x872d29295eb47eca lrc: 1/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.092471:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000510d584e/0x872d29295eb47eca lrc: 0/0,0 mode: --/PW res: [0x240000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.092515:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365374.092519:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000002bf0aef/0x872d29295eb47ed1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.092526:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb709200 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365374.092529:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000002bf0aef/0x872d29295eb47ed1 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.092538:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000002bf0aef/0x872d29295eb47ed1 lrc: 4/0,0 mode: PW/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.092549:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000002bf0aef/0x872d29295eb47ed1 lrc: 2/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365374.092556:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365374.092558:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365374.092560:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365374.092725:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:2.0:1787365374.092734:0:15091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000002bf0aef/0x872d29295eb47ed1 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.092812:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787365374.094836:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787365374.094850:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e9ed8d0/0x872d29295eb47ed8 lrc: 3/0,1 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.094867:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=491s v=(0 0) 00010000:00010000:2.0:1787365374.094871:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365374.094879:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000001e9ed8d0/0x872d29295eb47ed8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.094894:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000001e9ed8d0/0x872d29295eb47ed8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.094911:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000001e9ed8d0/0x872d29295eb47ed8 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.094919:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000001e9ed8d0/0x872d29295eb47ed8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.094939:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:2.0:1787365374.095396:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787365374.095403:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050a79875/0x872d29295eb47edf lrc: 3/0,1 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.095413:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=491s v=(0 0) 00010000:00010000:2.0:1787365374.095416:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365374.095421:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000050a79875/0x872d29295eb47edf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.095431:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000050a79875/0x872d29295eb47edf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.095439:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000050a79875/0x872d29295eb47edf lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.095446:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000050a79875/0x872d29295eb47edf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.095478:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787365374.095657:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787365374.095665:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000001e9ed8d0/0x872d29295eb47ed8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.095673:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27bb708a00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365374.095678:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000001e9ed8d0/0x872d29295eb47ed8 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.095686:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000001e9ed8d0/0x872d29295eb47ed8 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.095702:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000001e9ed8d0/0x872d29295eb47ed8 lrc: 1/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.095710:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000001e9ed8d0/0x872d29295eb47ed8 lrc: 0/0,0 mode: --/PW res: [0x240000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.095727:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365374.095730:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000050a79875/0x872d29295eb47edf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.095735:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cde00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365374.095744:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000050a79875/0x872d29295eb47edf lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.095752:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000050a79875/0x872d29295eb47edf lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.095763:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000050a79875/0x872d29295eb47edf lrc: 1/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.095770:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000050a79875/0x872d29295eb47edf lrc: 0/0,0 mode: --/PW res: [0x240000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.095782:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.095784:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.095786:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787365374.095882:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787365374.095888:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce66d7df/0x872d29295eb47ee6 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.095896:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=491s v=(0 0) 00010000:00010000:2.0:1787365374.095899:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365374.095903:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 00000000ce66d7df/0x872d29295eb47ee6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.095911:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 00000000ce66d7df/0x872d29295eb47ee6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.095919:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 00000000ce66d7df/0x872d29295eb47ee6 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.095927:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 00000000ce66d7df/0x872d29295eb47ee6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.095944:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787365374.095964:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365374.095968:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 00000000ce66d7df/0x872d29295eb47ee6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.095975:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cc200 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365374.095979:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce66d7df/0x872d29295eb47ee6 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.095986:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 00000000ce66d7df/0x872d29295eb47ee6 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.095997:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 00000000ce66d7df/0x872d29295eb47ee6 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.096011:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 00000000ce66d7df/0x872d29295eb47ee6 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.096024:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.096025:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.096027:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787365374.096337:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787365374.096344:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014f36579/0x872d29295eb47eed lrc: 3/0,1 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.096352:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=491s v=(0 0) 00010000:00010000:2.0:1787365374.096360:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365374.096365:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 0000000014f36579/0x872d29295eb47eed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.096375:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 0000000014f36579/0x872d29295eb47eed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.096383:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 0000000014f36579/0x872d29295eb47eed lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.096391:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 0000000014f36579/0x872d29295eb47eed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.096411:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787365374.096693:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365374.096698:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 0000000014f36579/0x872d29295eb47eed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.096706:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cdc00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365374.096710:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 0000000014f36579/0x872d29295eb47eed lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.096717:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 0000000014f36579/0x872d29295eb47eed lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.096730:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 0000000014f36579/0x872d29295eb47eed lrc: 1/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.096737:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 0000000014f36579/0x872d29295eb47eed lrc: 0/0,0 mode: --/PW res: [0x240000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.096749:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.096751:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.096753:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787365374.096809:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x240000400:0x6:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:2.0:1787365374.096816:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fa58d43/0x872d29295eb47ef4 lrc: 3/0,1 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.096824:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=491s v=(0 0) 00010000:00010000:2.0:1787365374.096828:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x240000400:0x6:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365374.096832:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0000_UUID lock: 000000000fa58d43/0x872d29295eb47ef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.096843:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0000_UUID lock: 000000000fa58d43/0x872d29295eb47ef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.096852:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0000_UUID lock: 000000000fa58d43/0x872d29295eb47ef4 lrc: 3/0,1 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.096867:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0000_UUID lock: 000000000fa58d43/0x872d29295eb47ef4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365374.096887:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787365374.097024:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365374.097029:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0000_UUID lock: 000000000fa58d43/0x872d29295eb47ef4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.097037:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cd200 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365374.097041:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0000_UUID lock: 000000000fa58d43/0x872d29295eb47ef4 lrc: 2/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.097049:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0000_UUID lock: 000000000fa58d43/0x872d29295eb47ef4 lrc: 3/0,0 mode: PW/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:2.0:1787365374.097058:0:15091:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0000: after destroy: set last_id to 0x240000400:5 00010000:00010000:1.0:1787365374.097060:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0000_UUID lock: 000000000fa58d43/0x872d29295eb47ef4 lrc: 1/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.097066:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0000_UUID lock: 000000000fa58d43/0x872d29295eb47ef4 lrc: 0/0,0 mode: --/PW res: [0x240000400:0x6:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365374.097077:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.097079:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365374.097080:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365374.097158:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad8380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14431:x1874188024513536:12345-0@lo:5:osp-pre-0-0.0 Request processed in 87748us (87883us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365374.097168:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00010000:3.0:1787365374.097387:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365374.097388:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbadb100 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14431:1874188024513536:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787365374.097418:0:14431:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0000-osc-MDT0000: Got last_id [0x240000400:0x21:0x0] from OST, last_created [0x240000400:0x21:0x0]last_used is [0x240000400:0x5:0x0] 00000100:00100000:0.0:1787365374.097464:0:14431:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2798099c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14431:1874188024513664:0@lo:5:osp-pre-0-0.0 00000100:00100000:0.0:1787365374.097502:0:14431:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365374.097549:0:14431:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2782b80300 going to sleep for 11 seconds 00000100:00100000:3.0:1787365374.097554:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024513664 00000100:00100000:3.0:1787365374.097561:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024513664 00000100:00100000:3.0:1787365374.097682:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787365374.097692:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279809b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:14431:x1874188024513664:12345-0@lo:5:osp-pre-0-0.0 00002000:00080000:3.0:1787365374.097729:0:15093:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0000: reserve 32 objects in group 0x240000400 at 34 00000100:00100000:3.0:1787365374.102777:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279809b100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+7:14431:x1874188024513664:12345-0@lo:5:osp-pre-0-0.0 Request processed in 5079us (5266us total) trans 8589934593 rc 0/0 00000100:00100000:3.0:1787365374.102790:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:0.0:1787365374.102931:0:14431:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2798099c00 pname:cluuid:pid:xid:nid:opc:job osp-pre-0-0:lustre-MDT0000-mdtlov_UUID:14431:1874188024513664:0@lo:5:osp-pre-0-0.0 00000004:00080000:0.0:1787365374.102945:0:14431:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0000-osc-MDT0000: current precreated pool: [0x240000400:0x21:0x0]-[0x240000400:0x41:0x0] 00010000:00010000:2.0:1787365374.643859:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365375.666778:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365376.692695:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365377.716872:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:01000004:2.0:1787365378.255531:0:15808:0:(obd_mount.c:923:lmd_print()) mount data: 00000020:01000004:2.0:1787365378.255535:0:15808:0:(obd_mount.c:926:lmd_print()) device: lustre-ost2/ost2 00000080:01200004:2.0:1787365378.255829:0:15808:0:(super25.c:131:lustre_fill_super()) VFS Op: sb ffff9f268673a000 00000020:01000004:2.0:1787365378.255845:0:15808:0:(tgt_mount.c:2500:osd_start()) Attempting to start lustre-OST0001, type=osd-zfs, lsifl=200002, mountfl=0 00000020:01000004:2.0:1787365378.255858:0:15808:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-OST0001-osd (typ=osd-zfs) 00000020:00000080:2.0:1787365378.255871:0:15808:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001-osd (ffff9f27bafb19b8) 00000020:00000080:2.0:1787365378.255886:0:15808:0:(obd_config.c:720:class_attach_name()) OBD: dev 15 attached type osd-zfs with refcount 2 00100000:10000000:2.0:1787365378.315053:0:15808:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000007:0x1:0x0] => 0 (ROOT): rc = 1 00100000:10000000:2.0:1787365378.316030:0:15808:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000001:0x3:0x0] (8/24) 00100000:10000000:2.0:1787365378.319085:0:15808:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x200000009:0x0:0x0] => 0 (update_log): rc = 1 00100000:10000000:2.0:1787365378.319500:0:15808:0:(osd_scrub.c:136:osd_scrub_refresh_mapping()) lustre-OST0001: refresh OI map for scrub, op 1, force yes, [0x20000000a:0x0:0x0] => 0 (update_log_dir): rc = 1 00100000:10000000:2.0:1787365378.319786:0:15808:0:(osd_scrub.c:915:osd_ios_index_register()) lustre-OST0001: registered index [0x200000003:0x3:0x0] (8/32) 00100000:10000000:2.0:1787365378.323466:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-client under 401: rc = 0 00100000:10000000:2.0:1787365378.323799:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled lustre-OST0001 under 401: rc = 0 00100000:10000000:2.0:1787365378.323896:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled params under 401: rc = 0 00100000:10000000:2.0:1787365378.324895:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000-OST0001 under 665: rc = 0 00100000:10000000:2.0:1787365378.326339:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000 under 665: rc = 0 00100000:10000000:2.0:1787365378.327939:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x20000-OST0001 under 665: rc = 0 00100000:10000000:2.0:1787365378.328938:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000-OST0001 under 665: rc = 0 00100000:10000000:2.0:1787365378.329249:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x1020000 under 665: rc = 0 00100000:10000000:2.0:1787365378.329498:0:15808:0:(osd_scrub.c:1174:osd_ios_general_sd()) lustre-OST0001: initial OI scrub handled 0x2020000 under 665: rc = 0 00000020:00000080:3.0:1787365378.336064:0:15808:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001-osd (uuid lustre-OST0001-osd_UUID) 00080000:01000000:3.0:1787365378.336078:0:15808:0:(osd_handler.c:1564:osd_obd_connect()) connect #0 00000020:00000080:3.0:1787365378.336090:0:15808:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x872d29295eb47f02 00000020:01000004:3.0:1787365378.336099:0:15808:0:(tgt_mount.c:2585:server_fill_super()) Found service lustre-OST0001 on device lustre-ost2/ost2 00000020:01000004:3.0:1787365378.336120:0:15808:0:(obd_mount.c:403:lustre_start_mgc()) MGC192.168.203.113@tcp:Set MGC reconnect 1 10000000:01000000:3.0:1787365378.336124:0:15808:0:(mgc_request.c:1071:mgc_set_info_async()) InitRecov MGC192.168.203.113@tcp 1/d0:i0:r0:or0:FULL 00000020:01000004:3.0:1787365378.336129:0:15808:0:(tgt_mount.c:1809:server_start_targets()) starting target lustre-OST0001 00000020:01000004:3.0:1787365378.336150:0:15808:0:(tgt_mount.c:280:server_mgc_set_fs()) Set mgc disk for lustre-ost2/ost2 10000000:01000000:3.0:1787365378.336155:0:15808:0:(mgc_request_server.c:89:mgc_fs_setup()) MGC192.168.203.113@tcp: cl_mgc_mutex lustre-OST0001-osd for locked: rc = 0 00000040:01000000:3.0:1787365378.355474:0:15808:0:(llog_obd.c:197:llog_setup()) obd MGC192.168.203.113@tcp ctxt 0 is initialized 00000020:01000004:3.0:1787365378.355514:0:15808:0:(tgt_mount.c:1418:server_register_target()) Registration lustre-OST0001, fs=lustre, 192.168.203.113@tcp, index=0001, flags=0x20002 00000020:01000004:3.0:1787365378.355518:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - server_register_target 00000020:01000004:3.0:1787365378.355520:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787365378.355522:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787365378.355523:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787365378.355524:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787365378.355525:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787365378.355526:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787365378.355528:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787365378.355529:0:15808:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787365378.355533:0:15808:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x10020002 00000020:01000004:3.0:1787365378.355535:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787365378.355536:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787365378.355537:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787365378.355538:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787365378.355539:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787365378.355540:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787365378.355541:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787365378.355542:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787365378.355543:0:15808:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 10000000:01000000:3.0:1787365378.355583:0:15808:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787365378.355605:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024513792:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787365378.355708:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365378.355764:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473ff00 going to sleep for 11 seconds 00000100:00100000:0.0:1787365378.355932:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024513792 00000100:00100000:0.0:1787365378.355940:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024513792 00000100:00100000:0.0:1787365378.355996:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 54 00000100:00100000:0.0:1787365378.356005:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:15808:x1874188024513792:12345-0@lo:253:mount.lustre.0 20000000:01000000:0.0:1787365378.356040:0:14401:0:(mgs_handler.c:479:mgs_target_reg()) fs: lustre index: 1 is registered to MGS. 20000000:01000000:0.0:1787365378.356043:0:14401:0:(mgs_handler.c:529:mgs_target_reg()) Server lustre-OST0001 is running on 0@lo 20000000:01000000:0.0:1787365378.356047:0:14401:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 00000100:00100000:0.0:1787365378.379228:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:15808:x1874188024513792:12345-0@lo:253:mount.lustre.0 Request processed in 23214us (23509us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365378.379244:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 54 00000100:00100000:3.0:1787365378.379412:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024513792:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787365378.379428:0:15808:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787365378.379431:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787365378.379433:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787365378.379434:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787365378.379436:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787365378.379437:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787365378.379438:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787365378.379440:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787365378.379441:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787365378.379443:0:15808:0:(tgt_mount.c:1216:server_mti_print()) LDD_F_OPC_REG 00000020:01000004:3.0:1787365378.379461:0:15808:0:(tgt_mount.c:101:server_register_mount()) register mount ffff9f268673a000 from lustre-OST0001 10000000:01000000:3.0:1787365378.379487:0:15808:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-OST0001 from 0 10000000:01000000:3.0:1787365378.379490:0:15808:0:(mgc_request.c:329:config_log_add()) add config log lustre-OST0001-0000000000000000 10000000:01000000:3.0:1787365378.379498:0:15808:0:(mgc_request_server.c:874:mgc_get_local_copy()) Get log lustre-sptlrpc-ffff9f27b6edcd28 local copy 00010000:00010000:3.0:1787365378.379508:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2798115800/0x872d29295eb47ca8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47caf expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365378.379756:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024513920:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787365378.379792:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365378.379829:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473f900 going to sleep for 11 seconds 00000100:00100000:1.0:1787365378.379971:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024513920 00000100:00100000:1.0:1787365378.379977:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024513920 00000100:00100000:1.0:1787365378.380030:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 55 00000100:00100000:1.0:1787365378.380039:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:15808:x1874188024513920:12345-0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787365378.380208:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:15808:x1874188024513920:12345-0@lo:501:mount.lustre.0 Request processed in 170us (415us total) trans 0 rc -2/-2 00000100:00100000:1.0:1787365378.380216:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 55 00000100:00100000:0.0:1787365378.380350:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf90e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024513920:0@lo:501:mount.lustre.0 10000000:01000000:0.0:1787365378.380363:0:15808:0:(mgc_request_server.c:765:mgc_llog_local_copy()) MGC192.168.203.113@tcp: no remote llog for lustre-sptlrpc, check MGS config 10000000:01000000:0.0:1787365378.380507:0:15808:0:(mgc_request_server.c:897:mgc_get_local_copy()) MGC192.168.203.113@tcp: can't save local copy of 'lustre-sptlrpc': rc = -2. 00010000:00010000:0.0:1787365378.380515:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2798115800/0x872d29295eb47ca8 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47caf expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365378.380526:0:15808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2798115800/0x872d29295eb47ca8 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 6 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47caf expref: -99 pid: 14390 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365378.380551:0:15808:0:(mgc_request.c:194:do_config_log_add()) do adding config log params-ffff9f268673a000 10000000:01000000:0.0:1787365378.380555:0:15808:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 10000000:01000000:0.0:1787365378.380560:0:15808:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-OST0001-0000000000000000 10000000:01000000:0.0:1787365378.380563:0:15808:0:(mgc_request.c:68:mgc_name2resid()) log lustre-OST0001 to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:0.0:1787365378.380567:0:15808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-OST0001-0000000000000000 from 1 10000000:01000000:0.0:1787365378.380569:0:15808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-OST0001 (res 0x65727473756c) 00010000:00010000:0.0:1787365378.380591:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27b6e23400/0x872d29295eb47f09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365378.380611:0:15808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27b6e23400/0x872d29295eb47f09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365378.380620:0:15808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27b6e23400/0x872d29295eb47f09 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365378.380670:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279809ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024514048:0@lo:101:mount.lustre.0 00000100:00100000:0.0:1787365378.380699:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365378.380721:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27a5b67000 going to sleep for 11 seconds 00000100:00100000:3.0:1787365378.380857:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024514048 00000100:00100000:3.0:1787365378.380863:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024514048 00000100:00100000:3.0:1787365378.380899:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 56 00000100:00100000:3.0:1787365378.380906:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:15808:x1874188024514048:12345-0@lo:101:mount.lustre.0 00010000:00010000:3.0:1787365378.380916:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365378.380929:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2788f45400/0x872d29295eb47f10 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb47f09 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365378.380950:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2788f45400/0x872d29295eb47f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb47f09 expref: 17 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365378.380972:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2788f45400/0x872d29295eb47f10 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47f09 expref: 17 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365378.380981:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45400, rc 0) 00000100:00100000:3.0:1787365378.381025:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+17:15808:x1874188024514048:12345-0@lo:101:mount.lustre.0 Request processed in 119us (325us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365378.381030:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 56 00000100:00100000:0.0:1787365378.381332:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279809ad80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024514048:0@lo:101:mount.lustre.0 00010000:00010000:0.0:1787365378.381347:0:15808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27b6e23400/0x872d29295eb47f09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47f10 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365378.381356:0:15808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27b6e23400/0x872d29295eb47f09 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb47f10 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:0.0:1787365378.381961:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 8 count 8 00000040:00080000:0.0:1787365378.382995:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:0.0:1787365378.383770:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].1, 224 off8416 00000040:00080000:0.0:1787365378.383822:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].2, 128 off8544 00000040:00080000:0.0:1787365378.383878:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].3, 112 off8656 00000040:00080000:0.0:1787365378.383931:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].4, 224 off8880 00000040:00080000:0.0:1787365378.383971:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].5, 224 off9104 00000040:00080000:1.0:1787365378.394193:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].6, 80 off9184 00000040:00080000:1.0:1787365378.394382:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x5:0x0].7, 224 off9408 00000040:00080000:1.0:1787365378.394393:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 7 count 8 00000100:00100000:1.0:1787365378.394501:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb408e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024514176:0@lo:501:mount.lustre.0 00000100:00100000:1.0:1787365378.394560:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365378.394812:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bc726540 going to sleep for 11 seconds 00000100:00100000:3.0:1787365378.397481:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024514176 00000100:00100000:3.0:1787365378.397496:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024514176 00000100:00100000:2.0:1787365378.397670:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 57 00000100:00100000:2.0:1787365378.397682:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+17:15808:x1874188024514176:12345-0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787365378.398136:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+17:15808:x1874188024514176:12345-0@lo:501:mount.lustre.0 Request processed in 455us (3575us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365378.398145:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 57 00000100:00100000:3.0:1787365378.398439:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb408e00 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024514176:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787365378.398486:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024514304:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787365378.398533:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365378.398570:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787365378.398622:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024514304 00000100:00100000:0.0:1787365378.398641:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024514304 00000100:00100000:0.0:1787365378.398667:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 58 00000100:00100000:0.0:1787365378.398674:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+17:15808:x1874188024514304:12345-0@lo:503:mount.lustre.0 00000100:00100000:0.0:1787365378.398954:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+17:15808:x1874188024514304:12345-0@lo:503:mount.lustre.0 Request processed in 280us (420us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365378.398968:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 58 00000100:00100000:3.0:1787365378.399113:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024514304:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787365378.399877:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787365378.399959:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024514432:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787365378.400244:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365378.400298:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787365378.400370:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024514432 00000100:00100000:0.0:1787365378.400376:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024514432 00000100:00100000:0.0:1787365378.400424:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 59 00000100:00100000:0.0:1787365378.400433:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+17:15808:x1874188024514432:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787365378.400621:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+17:15808:x1874188024514432:12345-0@lo:502:mount.lustre.0 Request processed in 190us (378us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365378.400650:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 59 00000100:00100000:3.0:1787365378.400741:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024514432:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787365378.400990:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].1, 224 off8416 00000040:00080000:2.0:1787365378.404445:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].2, 128 off8544 00000040:00080000:2.0:1787365378.404496:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].3, 112 off8656 00000040:00080000:2.0:1787365378.404571:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].4, 224 off8880 00000040:00080000:2.0:1787365378.404614:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].5, 224 off9104 00000040:00080000:2.0:1787365378.404681:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].6, 80 off9184 00000040:00080000:2.0:1787365378.404733:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].7, 224 off9408 00000040:00080000:2.0:1787365378.404775:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].8, 224 off9632 00000040:00080000:2.0:1787365378.404853:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].9, 120 off9752 00000100:00100000:2.0:1787365378.404906:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbada300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024514560:0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787365378.404984:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365378.405036:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6230000 going to sleep for 11 seconds 00000100:00100000:0.0:1787365378.405164:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024514560 00000100:00100000:0.0:1787365378.405171:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024514560 00000100:00100000:0.0:1787365378.405237:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 60 00000100:00100000:0.0:1787365378.405247:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+17:15808:x1874188024514560:12345-0@lo:502:mount.lustre.0 00000100:00100000:0.0:1787365378.405457:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+17:15808:x1874188024514560:12345-0@lo:502:mount.lustre.0 Request processed in 211us (473us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365378.405465:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 60 00000100:00100000:2.0:1787365378.405781:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbada300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024514560:0@lo:502:mount.lustre.0 00000040:00080000:2.0:1787365378.405861:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x6:0x0].10, 224 off9976 00000040:00080000:2.0:1787365378.405871:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x9:0x0] index 10 count 11 00000020:01000000:0.0:1787365378.406858:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:01000004:0.0:1787365378.406868:0:15809:0:(obd_mount.c:961:lustre_check_exclusion()) Check exclusion lustre-OST0001 (1) in 0 of lustre-ost2/ost2 00000020:00000080:0.0:1787365378.406875:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365378.406877:0:15809:0:(obd_config.c:1563:class_process_config()) marker 17 (0x1) lustre-OST0001 add ost 00000020:00000080:0.0:1787365378.406883:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf001 00000020:00000080:0.0:1787365378.406898:0:15809:0:(genops.c:413:class_newdev()) Allocate new device lustre-OST0001 (ffff9f278456b370) 00000020:00000080:0.0:1787365378.406921:0:15809:0:(obd_config.c:720:class_attach_name()) OBD: dev 16 attached type obdfilter with refcount 2 00000020:00000080:0.0:1787365378.406927:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf003 00000020:01000004:0.0:1787365378.406982:0:15809:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f268673a000 from lustre-OST0001, refs=2 00080000:01000000:0.0:1787365378.406990:0:15809:0:(osd_handler.c:1564:osd_obd_connect()) connect #1 00000020:00000080:0.0:1787365378.406997:0:15809:0:(genops.c:1385:class_connect()) connect: client lustre-OST0001-osd_UUID, cookie 0x872d29295eb47f1e 00010000:00010000:3.0:1787365378.452410:0:15809:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-filter-lustre-OST0001_UUID-3 is initialized 00000001:00000004:3.0:1787365378.453414:0:15809:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 4294967324 00080000:10000000:3.0:1787365378.455785:0:15809:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0xb:0x0] (8/8/4) registered 00000020:00000080:0.0:1787365378.461670:0:15809:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-OST0001 (uuid lustre-OST0001_UUID) 00000020:01000000:0.0:1787365378.461689:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787365378.461707:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365378.461710:0:15809:0:(obd_config.c:1563:class_process_config()) marker 17 (0x2) lustre-OST0001 add ost 00000020:01000000:0.0:1787365378.461714:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787365378.461719:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365378.461720:0:15809:0:(obd_config.c:1563:class_process_config()) marker 20 (0x1) lustre sys.timeout 00000020:00000080:0.0:1787365378.461722:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf009 00000020:00000080:0.0:1787365378.461724:0:15809:0:(obd_config.c:1537:class_process_config()) changing lustre timeout from 20 to 20 00000020:01000000:0.0:1787365378.461726:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787365378.461729:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365378.461730:0:15809:0:(obd_config.c:1563:class_process_config()) marker 20 (0x2) lustre sys.timeout 00000020:01000000:0.0:1787365378.461732:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:0.0:1787365378.461734:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365378.461735:0:15809:0:(obd_config.c:1563:class_process_config()) marker 24 (0x1) lustre sys.jobid_var 00000020:00000080:0.0:1787365378.461738:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf00f 00000020:01000000:0.0:1787365378.461796:0:15809:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:0.0:1787365378.461799:0:15809:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:0.0:1787365378.461800:0:15809:0:(obd_config.c:1563:class_process_config()) marker 24 (0x2) lustre sys.jobid_var 00000040:00080000:0.0:1787365378.461803:0:15809:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x6:0x0] index 11 count 11 00000020:01000000:2.0:1787365378.463001:0:15808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-OST0001 gen 1-10 (rc=0) 10000000:01000000:2.0:1787365378.463103:0:15808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-OST0001' succeeded (0). 00010000:00010000:2.0:1787365378.463125:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27b6e23400/0x872d29295eb47f09 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47f10 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.463148:0:15808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27b6e23400/0x872d29295eb47f09 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 7 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47f10 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365378.463157:0:15808:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f268673a000 from 1 10000000:01000000:2.0:1787365378.463160:0:15808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:2.0:1787365378.464558:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd800/0x872d29295eb47f25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.464573:0:15808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd800/0x872d29295eb47f25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.464586:0:15808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd800/0x872d29295eb47f25 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365378.464612:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbada300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024514688:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787365378.464891:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365378.464980:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6230000 going to sleep for 11 seconds 00000100:00100000:1.0:1787365378.466520:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024514688 00000100:00100000:1.0:1787365378.466533:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024514688 00000100:00100000:1.0:1787365378.466590:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 61 00000100:00100000:1.0:1787365378.466600:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+17:15808:x1874188024514688:12345-0@lo:101:mount.lustre.0 00010000:00010000:1.0:1787365378.466616:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365378.466650:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2798114600/0x872d29295eb47f2c lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb47f25 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365378.466678:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2798114600/0x872d29295eb47f2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb47f25 expref: 18 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365378.466690:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2798114600/0x872d29295eb47f2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47f25 expref: 18 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365378.466700:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798114600, rc 0) 00000100:00100000:1.0:1787365378.466765:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+18:15808:x1874188024514688:12345-0@lo:101:mount.lustre.0 Request processed in 167us (1875us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365378.466773:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 61 00000100:00100000:2.0:1787365378.466920:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbada300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024514688:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787365378.466939:0:15808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd800/0x872d29295eb47f25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47f2c expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.466949:0:15808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd800/0x872d29295eb47f25 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb47f2c expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787365378.476171:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 4 count 4 00000040:00080000:2.0:1787365378.482887:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787365378.483342:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].1, 224 off8416 00000040:00080000:2.0:1787365378.483389:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 112 off8528 00000040:00080000:2.0:1787365378.483466:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].3, 224 off8752 00000040:00080000:2.0:1787365378.483476:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 3 count 4 00000100:00100000:2.0:1787365378.483561:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbada300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024514816:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787365378.483622:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365378.484482:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6230000 going to sleep for 11 seconds 00000100:00100000:3.0:1787365378.485308:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024514816 00000100:00100000:3.0:1787365378.485317:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024514816 00000100:00100000:3.0:1787365378.485368:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787365378.485376:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+18:15808:x1874188024514816:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787365378.485615:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65aec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+18:15808:x1874188024514816:12345-0@lo:501:mount.lustre.0 Request processed in 239us (1992us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365378.485636:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 62 00000100:00100000:3.0:1787365378.490838:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbada300 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024514816:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787365378.490897:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024514944:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787365378.490968:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365378.491076:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27a5b67000 going to sleep for 11 seconds 00000100:00100000:3.0:1787365378.491099:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024514944 00000100:00100000:3.0:1787365378.491104:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024514944 00000100:00100000:3.0:1787365378.491147:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787365378.491156:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+18:15808:x1874188024514944:12345-0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787365378.491497:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65ac450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+18:15808:x1874188024514944:12345-0@lo:503:mount.lustre.0 Request processed in 341us (530us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365378.491504:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 63 00000100:00100000:3.0:1787365378.491546:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024514944:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787365378.493419:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787365378.493501:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024515072:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787365378.493569:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365378.493676:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27c00f7d80 going to sleep for 11 seconds 00000100:00100000:1.0:1787365378.496582:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024515072 00000100:00100000:1.0:1787365378.496595:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024515072 00000100:00100000:1.0:1787365378.496671:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787365378.496810:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+18:15808:x1874188024515072:12345-0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787365378.497127:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787869450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+18:15808:x1874188024515072:12345-0@lo:502:mount.lustre.0 Request processed in 321us (3557us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365378.497145:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 64 00000100:00100000:1.0:1787365378.497215:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf91500 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024515072:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787365378.497473:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].1, 224 off8416 00000040:00080000:1.0:1787365378.497527:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].2, 112 off8528 00000040:00080000:1.0:1787365378.497579:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].3, 224 off8752 00000040:00080000:1.0:1787365378.497619:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].4, 224 off8976 00000040:00080000:1.0:1787365378.497681:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].5, 112 off9088 00000040:00080000:1.0:1787365378.497938:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].6, 224 off9312 00000040:00080000:1.0:1787365378.497979:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].7, 224 off9536 00000040:00080000:1.0:1787365378.498080:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].8, 128 off9664 00000100:00100000:1.0:1787365378.498120:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb408a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024515200:0@lo:502:mount.lustre.0 00000100:00100000:1.0:1787365378.498173:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365378.498211:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bc726300 going to sleep for 11 seconds 00000100:00100000:3.0:1787365378.498547:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024515200 00000100:00100000:3.0:1787365378.498554:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024515200 00000100:00100000:3.0:1787365378.498595:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 65 00000100:00100000:3.0:1787365378.498603:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+18:15808:x1874188024515200:12345-0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787365378.499386:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65be450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+18:15808:x1874188024515200:12345-0@lo:502:mount.lustre.0 Request processed in 781us (1211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365378.499396:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 65 00000100:00100000:1.0:1787365378.500073:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb408a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024515200:0@lo:502:mount.lustre.0 00000040:00080000:1.0:1787365378.500210:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x8:0x0].9, 224 off9888 00000040:00080000:1.0:1787365378.500224:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 9 count 10 00000020:01000000:3.0:1787365378.502003:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787365378.502026:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365378.502028:0:15815:0:(obd_config.c:1563:class_process_config()) marker 2 (0x1) general debug_raw_pointers 00000020:01000000:3.0:1787365378.502038:0:15815:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f268673a000 00000020:00000080:3.0:1787365378.502040:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787365378.502047:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787365378.502050:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365378.502051:0:15815:0:(obd_config.c:1563:class_process_config()) marker 2 (0x2) general debug_raw_pointers 00000020:01000000:3.0:1787365378.502053:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787365378.502056:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365378.502057:0:15815:0:(obd_config.c:1563:class_process_config()) marker 3 (0x1) general lod.*.mdt_hash 00000020:01000000:3.0:1787365378.502060:0:15815:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: general-ffff9f268673a000 00000020:00000080:3.0:1787365378.502062:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787365378.502150:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787365378.502154:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365378.502155:0:15815:0:(obd_config.c:1563:class_process_config()) marker 3 (0x2) general lod.*.mdt_hash 00000020:01000000:3.0:1787365378.502158:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x0 mark_flg=0x1 00000020:00000080:3.0:1787365378.502160:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365378.502161:0:15815:0:(obd_config.c:1563:class_process_config()) marker 4 (0x1) lustre mdt.lustre-MDT0000.hsm_control 00000020:01000000:3.0:1787365378.502165:0:15815:0:(obd_config.c:2004:class_config_llog_handler()) cmd ce032, instance name: lustre-ffff9f268673a000 00000020:00000080:3.0:1787365378.502166:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: ce032 00000020:01000000:3.0:1787365378.510371:0:15815:0:(obd_config.c:1893:class_config_llog_handler()) Marker, inst_flg=0x2 mark_flg=0x2 00000020:00000080:3.0:1787365378.510385:0:15815:0:(obd_config.c:1472:class_process_config()) processing cmd: cf010 00000020:00000080:3.0:1787365378.510387:0:15815:0:(obd_config.c:1563:class_process_config()) marker 4 (0x2) lustre mdt.lustre-MDT0000.hsm_control 00000040:00080000:3.0:1787365378.510394:0:15815:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x8:0x0] index 10 count 10 00000020:01000000:2.0:1787365378.516832:0:15808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 1-9 (rc=0) 10000000:01000000:2.0:1787365378.516876:0:15808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:2.0:1787365378.516896:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd800/0x872d29295eb47f25 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47f2c expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.516908:0:15808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd800/0x872d29295eb47f25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47f2c expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365378.516955:0:15808:0:(mgc_request.c:1944:mgc_process_config()) parse_log lustre-client from 0 10000000:01000000:2.0:1787365378.516957:0:15808:0:(mgc_request.c:329:config_log_add()) add config log lustre-client-ffff9f268673a000 10000000:01000000:2.0:1787365378.516960:0:15808:0:(mgc_request.c:194:do_config_log_add()) do adding config log lustre-client-ffff9f268673a000 10000000:01000000:2.0:1787365378.516964:0:15808:0:(mgc_request.c:68:mgc_name2resid()) log lustre-client to resid 0x65727473756c/0x0 (lustre) 10000000:01000000:2.0:1787365378.516969:0:15808:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-client-ffff9f268673a000 from 1 10000000:01000000:2.0:1787365378.516971:0:15808:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-client (res 0x65727473756c) 00010000:00010000:2.0:1787365378.517018:0:15808:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb47f33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.517026:0:15808:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb47f33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.517036:0:15808:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb47f33 lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365378.517058:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbad8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024515328:0@lo:101:mount.lustre.0 00000100:00100000:2.0:1787365378.517120:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365378.517162:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6230540 going to sleep for 11 seconds 00000100:00100000:2.0:1787365378.517180:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024515328 00000100:00100000:2.0:1787365378.517185:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024515328 00000100:00100000:2.0:1787365378.517219:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787365378.517228:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+18:15808:x1874188024515328:12345-0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787365378.517239:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365378.517250:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a12cda00/0x872d29295eb47f3a lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb47f33 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.517270:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a12cda00/0x872d29295eb47f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb47f33 expref: 19 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.517280:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a12cda00/0x872d29295eb47f3a lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47f33 expref: 19 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.517301:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cda00, rc 0) 00000100:00100000:2.0:1787365378.517334:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bc450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:15808:x1874188024515328:12345-0@lo:101:mount.lustre.0 Request processed in 107us (215us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365378.517341:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 66 00000100:00100000:2.0:1787365378.517383:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbad8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024515328:0@lo:101:mount.lustre.0 00010000:00010000:2.0:1787365378.517395:0:15808:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb47f33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47f3a expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.517403:0:15808:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb47f33 lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb47f3a expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000040:00080000:2.0:1787365378.518020:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 39 count 39 00000040:00080000:2.0:1787365378.518303:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:2.0:1787365378.518555:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].1, 224 off8416 00000040:00080000:2.0:1787365378.518612:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].2, 120 off8536 00000040:00080000:2.0:1787365378.518674:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].3, 168 off8704 00000040:00080000:2.0:1787365378.518740:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].4, 224 off8928 00000040:00080000:2.0:1787365378.518783:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].5, 224 off9152 00000040:00080000:2.0:1787365378.518834:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].6, 120 off9272 00000040:00080000:2.0:1787365378.518870:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].7, 168 off9440 00000040:00080000:2.0:1787365378.518904:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].8, 224 off9664 00000040:00080000:2.0:1787365378.518955:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].9, 224 off9888 00000040:00080000:2.0:1787365378.518989:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].10, 120 off10008 00000040:00080000:2.0:1787365378.519025:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].11, 224 off10232 00000040:00080000:2.0:1787365378.519076:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].12, 224 off10456 00000040:00080000:2.0:1787365378.519110:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].13, 88 off10544 00000040:00080000:2.0:1787365378.519139:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].14, 128 off10672 00000040:00080000:2.0:1787365378.519186:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].15, 144 off10816 00000040:00080000:2.0:1787365378.519224:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].16, 160 off10976 00000040:00080000:2.0:1787365378.519258:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].17, 224 off11200 00000040:00080000:2.0:1787365378.519319:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].18, 224 off11424 00000040:00080000:2.0:1787365378.519372:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].19, 80 off11504 00000040:00080000:2.0:1787365378.519402:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].20, 224 off11728 00000040:00080000:2.0:1787365378.519449:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].21, 224 off11952 00000040:00080000:2.0:1787365378.519485:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].22, 88 off12040 00000040:00080000:2.0:1787365378.519515:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].23, 128 off12168 00000040:00080000:2.0:1787365378.519557:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].24, 144 off12312 00000040:00080000:2.0:1787365378.519593:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].25, 128 off12440 00000040:00080000:2.0:1787365378.519654:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].26, 224 off12664 00000040:00080000:2.0:1787365378.519707:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].27, 224 off12888 00000040:00080000:2.0:1787365378.519745:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].28, 80 off12968 00000040:00080000:2.0:1787365378.519778:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].29, 224 off13192 00000040:00080000:2.0:1787365378.519825:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].30, 224 off13416 00000040:00080000:2.0:1787365378.519860:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].31, 88 off13504 00000040:00080000:2.0:1787365378.519893:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].32, 128 off13632 00000040:00080000:2.0:1787365378.519927:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].33, 144 off13776 00000040:00080000:2.0:1787365378.519976:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].34, 128 off13904 00000040:00080000:2.0:1787365378.520033:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].35, 224 off14128 00000040:00080000:2.0:1787365378.520079:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].36, 224 off14352 00000040:00080000:2.0:1787365378.520112:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].37, 80 off14432 00000040:00080000:2.0:1787365378.520193:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x9:0x0].38, 224 off14656 00000040:00080000:2.0:1787365378.520200:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x4:0x0] index 38 count 39 00000001:00100000:3.0:1787365378.526872:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000001:00080000:3.0:1787365378.526887:0:6707:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0000: transno 8589934593 is committed 00000100:00100000:2.0:1787365378.529845:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbad8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024515456:0@lo:501:mount.lustre.0 00000100:00100000:2.0:1787365378.529909:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365378.529952:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b6230540 going to sleep for 11 seconds 00000100:00100000:3.0:1787365378.530111:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024515456 00000100:00100000:3.0:1787365378.530125:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024515456 00000100:00100000:3.0:1787365378.530165:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787365378.530173:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:15808:x1874188024515456:12345-0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787365378.530441:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bd850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:15808:x1874188024515456:12345-0@lo:501:mount.lustre.0 Request processed in 268us (531us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365378.530449:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 67 00000100:00100000:3.0:1787365378.530496:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbad8a80 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024515456:0@lo:501:mount.lustre.0 00000100:00100000:3.0:1787365378.530535:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024515584:0@lo:503:mount.lustre.0 00000100:00100000:3.0:1787365378.530573:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365378.530599:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878be000 going to sleep for 11 seconds 00000100:00100000:2.0:1787365378.530785:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024515584 00000100:00100000:2.0:1787365378.530791:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024515584 00000100:00100000:2.0:1787365378.530819:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 68 00000100:00100000:2.0:1787365378.530826:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:15808:x1874188024515584:12345-0@lo:503:mount.lustre.0 00000100:00100000:2.0:1787365378.531123:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bf450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:15808:x1874188024515584:12345-0@lo:503:mount.lustre.0 Request processed in 295us (547us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365378.531130:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 68 00000100:00100000:3.0:1787365378.531797:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024515584:0@lo:503:mount.lustre.0 00000040:00080000:3.0:1787365378.535579:0:15808:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000100:00100000:3.0:1787365378.535768:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024515712:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787365378.535850:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365378.535897:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878be000 going to sleep for 11 seconds 00000100:00100000:2.0:1787365378.536807:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024515712 00000100:00100000:2.0:1787365378.536818:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024515712 00000100:00100000:2.0:1787365378.536875:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 69 00000100:00100000:2.0:1787365378.536885:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:15808:x1874188024515712:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787365378.538267:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bf050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:15808:x1874188024515712:12345-0@lo:502:mount.lustre.0 Request processed in 1377us (2410us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365378.538279:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 69 00000100:00100000:3.0:1787365378.538391:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024515712:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787365378.539103:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].1, 224 off8416 00000040:00080000:3.0:1787365378.539166:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].2, 120 off8536 00000040:00080000:3.0:1787365378.539201:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].3, 168 off8704 00000040:00080000:3.0:1787365378.539251:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].4, 224 off8928 00000040:00080000:3.0:1787365378.539300:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].5, 224 off9152 00000040:00080000:3.0:1787365378.539351:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].6, 120 off9272 00000040:00080000:3.0:1787365378.539388:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].7, 168 off9440 00000040:00080000:3.0:1787365378.539420:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].8, 224 off9664 00000040:00080000:3.0:1787365378.539463:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].9, 224 off9888 00000040:00080000:3.0:1787365378.541145:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].10, 120 off10008 00000040:00080000:3.0:1787365378.541216:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].11, 224 off10232 00000040:00080000:3.0:1787365378.541969:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].12, 224 off10456 00000040:00080000:3.0:1787365378.542848:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].13, 88 off10544 00000040:00080000:3.0:1787365378.542901:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].14, 128 off10672 00000040:00080000:3.0:1787365378.542960:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].15, 144 off10816 00000040:00080000:3.0:1787365378.542997:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].16, 160 off10976 00000040:00080000:3.0:1787365378.543120:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].17, 224 off11200 00000040:00080000:3.0:1787365378.543172:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].18, 224 off11424 00000040:00080000:3.0:1787365378.543210:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].19, 80 off11504 00000040:00080000:3.0:1787365378.543245:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].20, 224 off11728 00000040:00080000:3.0:1787365378.543308:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].21, 224 off11952 00000040:00080000:3.0:1787365378.543346:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].22, 88 off12040 00000040:00080000:3.0:1787365378.543380:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].23, 128 off12168 00000040:00080000:3.0:1787365378.543430:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].24, 144 off12312 00000040:00080000:3.0:1787365378.543467:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].25, 128 off12440 00000040:00080000:3.0:1787365378.543520:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].26, 224 off12664 00000040:00080000:3.0:1787365378.543563:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].27, 224 off12888 00000040:00080000:3.0:1787365378.543599:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].28, 80 off12968 00000040:00080000:3.0:1787365378.543655:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].29, 224 off13192 00000040:00080000:3.0:1787365378.545197:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].30, 224 off13416 00000040:00080000:3.0:1787365378.545268:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].31, 88 off13504 00000040:00080000:3.0:1787365378.545318:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].32, 128 off13632 00000040:00080000:3.0:1787365378.545354:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].33, 144 off13776 00000040:00080000:3.0:1787365378.545420:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].34, 128 off13904 00000040:00080000:3.0:1787365378.545461:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].35, 224 off14128 00000040:00080000:3.0:1787365378.545525:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].36, 224 off14352 00000040:00080000:3.0:1787365378.545565:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].37, 80 off14432 00000040:00080000:3.0:1787365378.545597:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].38, 224 off14656 00000040:00080000:3.0:1787365378.545668:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].39, 224 off14880 00000040:00080000:3.0:1787365378.545719:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].40, 120 off15000 00000100:00100000:3.0:1787365378.547851:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024515840:0@lo:502:mount.lustre.0 00000100:00100000:3.0:1787365378.547928:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365378.548023:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878be000 going to sleep for 11 seconds 00000100:00100000:2.0:1787365378.555130:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024515840 00000100:00100000:2.0:1787365378.555142:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024515840 00000100:00100000:2.0:1787365378.555215:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 70 00000100:00100000:2.0:1787365378.555226:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:15808:x1874188024515840:12345-0@lo:502:mount.lustre.0 00000100:00100000:2.0:1787365378.555506:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bdc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:15808:x1874188024515840:12345-0@lo:502:mount.lustre.0 Request processed in 282us (7577us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365378.555520:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 70 00000100:00100000:3.0:1787365378.556440:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024515840:0@lo:502:mount.lustre.0 00000040:00080000:3.0:1787365378.556564:0:15808:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0xa:0x0].41, 224 off15224 00000040:00080000:3.0:1787365378.556579:0:15808:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x3:0x0] index 41 count 42 00000020:01000004:3.0:1787365378.557330:0:15820:0:(obd_mount.c:230:lustre_start_simple()) Starting OBD lustre-MDT0000-lwp-OST0001 (typ=lwp) 00000020:00000080:3.0:1787365378.557344:0:15820:0:(genops.c:413:class_newdev()) Allocate new device lustre-MDT0000-lwp-OST0001 (ffff9f27b6ed99b8) 00000020:00000080:3.0:1787365378.557368:0:15820:0:(obd_config.c:720:class_attach_name()) OBD: dev 17 attached type lwp with refcount 2 00000020:01000004:3.0:1787365378.557433:0:15820:0:(tgt_mount.c:153:server_get_mount()) get mount ffff9f268673a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787365378.557437:0:15820:0:(tgt_mount.c:187:server_put_mount()) put mount ffff9f268673a000 from lustre-OST0001, refs=3 00000020:01000004:3.0:1787365378.557439:0:15820:0:(obd_mount.c:710:lustre_put_lsi()) put ffff9f268673a000 3 00010000:00080000:3.0:1787365378.557466:0:15820:0:(ldlm_lib.c:102:import_set_conn()) imp ffff9f2784b75800@lustre-MDT0000-lwp-OST0001: add connection 192.168.203.113@tcp at head 00010000:00010000:3.0:1787365378.559102:0:15820:0:(ldlm_pool.c:923:ldlm_pool_init()) Lock pool ldlm-pool-lustre-MDT0000-lwp-OST0001-5 is initialized 00000020:00000080:2.0:1787365378.560961:0:15820:0:(obd_config.c:826:class_setup()) finished setup of obd lustre-MDT0000-lwp-OST0001 (uuid lustre-MDT0000-lwp-OST0001_UUID) 00000010:01000000:2.0:1787365378.561097:0:15820:0:(lwp_dev.c:513:lwp_obd_connect()) connect #0 00000020:00000080:2.0:1787365378.561112:0:15820:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001, cookie 0x872d29295eb47f48 00000100:00080000:2.0:1787365378.561122:0:15820:0:(import.c:510:import_select_connection()) lustre-MDT0000-lwp-OST0001: connect to NID 0@lo last attempt 0 00000100:00080000:2.0:1787365378.561128:0:15820:0:(import.c:624:import_select_connection()) lustre-MDT0000-lwp-OST0001: import ffff9f2784b75800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1787365378.561161:0:15820:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f27bbad8700 x1874188024515968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787365378.561197:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbad8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874188024515968:0@lo:38:llog_process_th.0 00000100:00100000:2.0:1787365378.561262:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:2.0:1787365378.561325:0:15820:0:(pinger.c:373:ptlrpc_pinger_add_import()) adding pingable import lustre-MDT0000-lwp-OST0001_UUID->lustre-MDT0000_UUID 00000100:00080000:2.0:1787365378.561365:0:8:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:2.0:1787365378.561369:0:8:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:2.0:1787365378.561372:0:8:0:(import.c:65:import_set_state_nolock()) ffff9f27bbae3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:2.0:1787365378.561376:0:8:0:(import.c:510:import_select_connection()) lustre-OST0001-osc-MDT0000: connect to NID 0@lo last attempt 491 00000100:00080000:2.0:1787365378.561380:0:8:0:(import.c:589:import_select_connection()) lustre-OST0001-osc-MDT0000: tried all connections, increasing latency to 15s 00000100:00080000:2.0:1787365378.561383:0:8:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f27bbae3800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:2.0:1787365378.561395:0:8:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f27bbadb800 x1874188024516224/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:2.0:1787365378.561435:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024516096:0@lo:400:kworker.0 00000100:00100000:2.0:1787365378.561461:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365378.561486:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024516224:0@lo:8:kworker.0 00000100:00100000:2.0:1787365378.561504:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365378.561523:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024516352:0@lo:400:kworker.0 00000100:00100000:2.0:1787365378.561552:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365378.561569:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787365378.561574:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024516480:0@lo:400:kworker.0 00000100:00100000:2.0:1787365378.561590:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365378.561613:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024516096 00000100:00100000:2.0:1787365378.561618:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024516096 00000100:00100000:2.0:1787365378.562764:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024516224 00000100:00100000:2.0:1787365378.562774:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024516224 00000100:00100000:2.0:1787365378.562802:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787365378.562813:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbadb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024516096:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365378.562879:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbadb100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024516096:12345-0@lo:400:kworker.0 Request processed in 70us (1418us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365378.562886:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:2.0:1787365378.562900:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787365378.562904:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbadb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1874188024516224:12345-0@lo:8:kworker.0 00000100:00100000:2.0:1787365378.562941:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbadb480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1874188024516224:12345-0@lo:8:kworker.0 Request processed in 35us (1436us total) trans 0 rc -11/-11 00000100:00100000:2.0:1787365378.562947:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787365378.562966:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024515968 00000100:00100000:2.0:1787365378.562969:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024515968 00000100:00100000:2.0:1787365378.562979:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024516352 00000100:00100000:2.0:1787365378.562982:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024516352 00000100:00100000:2.0:1787365378.562994:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024516480 00000100:00100000:2.0:1787365378.562996:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024516480 00000100:00100000:1.0:1787365378.563136:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:2.0:1787365378.563170:0:14410:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787365378.563176:0:14410:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'mdt00_003' 00000100:00100000:2.0:1787365378.563191:0:14409:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:2.0:1787365378.563198:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00080000:3.0:1787365378.564175:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365378.566936:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024516352:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365378.567050:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbada680 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024516352:12345-0@lo:400:kworker.0 Request processed in 3906us (5496us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365378.567061:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:1.0:1787365378.567092:0:14408:0:(service.c:3462:ptlrpc_start_thread()) mdt[0] started 3 min 3 max 116 00000100:00100000:1.0:1787365378.567103:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787365378.567109:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:0+-99:3309:x1874188024515968:12345-0@lo:38:llog_process_th.0 00010000:00080000:1.0:1787365378.567133:0:14408:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from lustre-MDT0000-lwp-OST0001_UUID@0@lo t0 exp 0000000000000000 cur 495 last 0 00000020:00000080:1.0:1787365378.567169:0:14408:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-lwp-OST0001_UUID, cookie 0x872d29295eb47f4f 00000004:00100000:1.0:1787365378.567194:0:14408:0:(mdt_handler.c:7297:mdt_connect_internal()) lustre-MDT0000: cli does not support OBD_CONNECT_CKSUM, CRC32 will be used 00000100:00080000:1.0:1787365378.567225:0:14408:0:(import.c:65:import_set_state_nolock()) ffff9f27882fd800 : changing import state from RECOVER to FULL 00000100:00100000:1.0:1787365378.567262:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3309:x1874188024515968:12345-0@lo:38:llog_process_th.0 Request processed in 152us (5999us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365378.567269:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787365378.567421:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024516480:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365378.567466:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad9f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024516480:12345-0@lo:400:kworker.0 Request processed in 4262us (5874us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365378.567473:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787365378.567516:0:3311:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0000-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:2.0:1787365378.567532:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbad8e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024516096:0@lo:400:kworker.0 00000100:00100000:2.0:1787365378.567558:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787365378.567562:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9f27bbae3800 lustre-OST0001_UUID: changing import state from CONNECTING to DISCONN 00000100:00080000:2.0:1787365378.567566:0:3309:0:(import.c:1511:ptlrpc_connect_interpret()) recovery of lustre-OST0001_UUID on 0@lo failed (-11) 00000100:00100000:2.0:1787365378.567569:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbadb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024516224:0@lo:8:kworker.0 00010000:00080000:2.0:1787365378.567582:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bbad8700 x1874188024515968/t0(0) o38->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 520/416 e 0 to 0 dl 1787365388 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'llog_process_th.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365378.567590:0:3309:0:(client.c:3125:ptlrpc_free_committed()) lustre-MDT0000-lwp-OST0001: committing for last_committed 0 gen 2 00000100:00080000:2.0:1787365378.567595:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-MDT0000-lwp-OST0001: connect to target with instance 2 00000100:00080000:2.0:1787365378.567602:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-MDT0000-lwp-OST0001: Resetting ns_connect_flags to server flags: 0x2041401043000020 00000100:00080000:2.0:1787365378.567605:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-MDT0000_UUID 00000100:00080000:2.0:1787365378.567608:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9f2784b75800 lustre-MDT0000_UUID: changing import state from CONNECTING to FULL 00000100:00100000:2.0:1787365378.567612:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbad8700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-lwp-OST0001_UUID:3309:1874188024515968:0@lo:38:llog_process_th.0 00000100:00080000:3.0:1787365378.567834:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00080000:2.0:1787365378.568054:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bbada300 x1874188024516480/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365378.568066:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbada300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024516480:0@lo:400:kworker.0 00010000:00080000:2.0:1787365378.568076:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=92324) req@ffff9f27bbad8a80 x1874188024516352/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365394 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365378.568085:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024516352:0@lo:400:kworker.0 00000040:00080000:2.0:1787365378.572953:0:15820:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0xa:0x0] index 42 count 42 00000020:01000000:3.0:1787365378.573415:0:15808:0:(obd_config.c:2145:class_config_parse_llog()) Processed log lustre-client gen 1-41 (rc=0) 10000000:01000000:3.0:1787365378.573443:0:15808:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-client' succeeded (0). 00010000:00010000:3.0:1787365378.573465:0:15808:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb47f33 lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47f3a expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365378.573477:0:15808:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd600/0x872d29295eb47f33 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 8 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47f3a expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000020:01000004:3.0:1787365378.573523:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - server_notify_target 00000020:01000004:3.0:1787365378.573526:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787365378.573527:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787365378.573529:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787365378.573530:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787365378.573531:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787365378.573533:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787365378.573535:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787365378.573536:0:15808:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787365378.573540:0:15808:0:(mgc_request_server.c:451:mgc_set_info_async_server()) register_target lustre-OST0001 0x40020002 00000020:01000004:3.0:1787365378.573542:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: req 00000020:01000004:3.0:1787365378.573550:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787365378.573551:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787365378.573552:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787365378.573553:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787365378.573554:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787365378.573555:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787365378.573556:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787365378.573557:0:15808:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 10000000:01000000:3.0:1787365378.573583:0:15808:0:(mgc_request_server.c:281:mgc_target_register()) register lustre-OST0001 00000100:00100000:3.0:1787365378.573603:0:15808:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024516608:0@lo:253:mount.lustre.0 00000100:00100000:3.0:1787365378.574871:0:15808:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365378.575448:0:15808:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878bed80 going to sleep for 11 seconds 00000100:00100000:1.0:1787365378.576430:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024516608 00000100:00100000:1.0:1787365378.576439:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024516608 00000100:00100000:1.0:1787365378.576514:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 71 00000100:00100000:1.0:1787365378.576524:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:15808:x1874188024516608:12345-0@lo:253:mount.lustre.0 20000000:01000000:1.0:1787365378.576551:0:14402:0:(mgs_handler.c:453:mgs_target_reg()) fs: lustre index: 1 is ready to reconnect. 20000000:01000000:1.0:1787365378.576563:0:14402:0:(mgs_nids.c:463:mgs_tnl_update()) nidtbl: write 1 NIDs to NET #0 20000000:01000000:1.0:1787365378.598305:0:14402:0:(mgs_nids.c:815:mgs_ir_update()) Try to revoke recover lock of lustre 20000000:01000000:1.0:1787365378.598318:0:14402:0:(mgs_handler.c:637:mgs_target_reg()) replying with lustre-OST0001, index=1, rc=0 20000000:01000000:2.0:1787365378.598526:0:14424:0:(mgs_nids.c:712:mgs_ir_notify()) mgs_lustre_notify woken up, phase is 1 10000000:01000000:2.0:1787365378.598531:0:14424:0:(mgc_request.c:68:mgc_name2resid()) log lustre to resid 0x65727473756c/0x2 (lustre) 00010000:00010000:2.0:1787365378.598551:0:14424:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f27a12cc000/0x872d29295eb47f56 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.598569:0:14424:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f27b6e22200/0x872d29295eb47e29 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47e22 expref: 19 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.598578:0:14424:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f27a12cc000/0x872d29295eb47f56 lrc: 4/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.598616:0:14424:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f27b6e22200/0x872d29295eb47e29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb47e22 expref: 19 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.598814:0:14424:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f27b6e22200/0x872d29295eb47e29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb47e22 expref: 19 pid: 14401 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365378.598830:0:14424:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbad8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14424:1874188024516736:0@lo:104: 00000100:00100000:2.0:1787365378.598892:0:14424:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365378.598937:0:14424:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27bb9e3f00 going to sleep for 11 seconds 00000100:00100000:1.0:1787365378.599057:0:14392:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024516736 00000100:00100000:1.0:1787365378.599064:0:14392:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024516736 00000100:00100000:1.0:1787365378.599118:0:14392:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:1.0:1787365378.599127:0:14392:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbada300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+3:14424:x1874188024516736:12345-0@lo:104: 00010000:00010000:1.0:1787365378.599138:0:14392:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f2788f45600/0x872d29295eb47e22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb47e29 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365378.599185:0:14392:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:1.0:1787365378.599191:0:14392:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbada300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+3:14424:x1874188024516736:12345-0@lo:104: Request processed in 66us (299us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365378.599198:0:14392:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787365378.599362:0:14424:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbad8a80 pname:cluuid:pid:xid:nid:opc:job mgs_lustre_noti:MGS:14424:1874188024516736:0@lo:104: 00010000:00010000:2.0:1787365378.599379:0:14424:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f27a12cc000/0x872d29295eb47f56 lrc: 3/0,1 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.599395:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:2.0:1787365378.599401:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f2788f45600/0x872d29295eb47e22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb47e29 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.599409:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45600 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:2.0:1787365378.599425:0:14396:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f2788f45600/0x872d29295eb47e22 lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb47e29 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.599433:0:14396:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f2788f45600/0x872d29295eb47e22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb47e29 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:2.0:1787365378.599440:0:14396:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f2788f45600/0x872d29295eb47e22 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb47e29 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:2.0:1787365378.599447:0:14396:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x65727473756c:0x2:0x0].0x0 (lustre) 00010000:00010000:2.0:1787365378.599478:0:14396:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f2788f45600/0x872d29295eb47e22 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb47e29 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.599484:0:14396:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:2.0:1787365378.599510:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f2788f45600/0x872d29295eb47e22 lrc: 1/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb47e29 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.599518:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f2788f45600/0x872d29295eb47e22 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb47e29 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.599531:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365378.599533:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365378.599535:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365378.599543:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787365378.599554:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3311:1874188024516864:0@lo:103:ldlm_bl.0 00000100:00100000:2.0:1787365378.599583:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365378.599610:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024516864 00000100:00100000:2.0:1787365378.599614:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024516864 00010000:00010000:2.0:1787365378.599663:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f27b6e22200/0x872d29295eb47e29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb47e22 expref: 20 pid: 14401 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365378.599776:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787365378.599784:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+20:3311:x1874188024516864:12345-0@lo:103:ldlm_bl.0 00010000:00010000:2.0:1787365378.599796:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365378.599801:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f27b6e22200/0x872d29295eb47e29 lrc: 4/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb47e22 expref: 20 pid: 14401 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.599810:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f27b6e22200/0x872d29295eb47e29 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb47e22 expref: 20 pid: 14401 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.599823:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27b6e22200/0x872d29295eb47e29 lrc: 0/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb47e22 expref: 20 pid: 14401 timeout: 595 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.599835:0:14395:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f27a12cc000/0x872d29295eb47f56 lrc: 3/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.599843:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a12cc000/0x872d29295eb47f56 lrc: 4/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 20000000:01000000:2.0:1787365378.599854:0:14395:0:(mgs_nids.c:688:mgs_ir_notify_complete()) Revoke recover lock of lustre completed after 0.001386039s 00010000:00010000:2.0:1787365378.599858:0:14395:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f27a12cc000/0x872d29295eb47f56 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.599864:0:14395:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f27a12cc000/0x872d29295eb47f56 lrc: 5/0,1 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.599870:0:14395:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f27a12cc000/0x872d29295eb47f56 lrc: 4/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.599876:0:14395:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f27a12cc000/0x872d29295eb47f56 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.599888:0:14395:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cc000 already unused, calling callback (ffffffffc1672420) 00010000:00010000:2.0:1787365378.599891:0:14395:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f27a12cc000/0x872d29295eb47f56 lrc: 5/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.599898:0:14395:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f27a12cc000/0x872d29295eb47f56 lrc: 6/0,0 mode: EX/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.599911:0:14395:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f27a12cc000/0x872d29295eb47f56 lrc: 4/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.599920:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365378.599948:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad8700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:3311:x1874188024516864:12345-0@lo:103:ldlm_bl.0 Request processed in 166us (364us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365378.599956:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00010000:00010000:2.0:1787365378.599973:0:14424:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f27a12cc000/0x872d29295eb47f56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.599980:0:14424:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f27a12cc000/0x872d29295eb47f56 lrc: 1/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365378.599987:0:14424:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a12cc000/0x872d29295eb47f56 lrc: 0/0,0 mode: --/EX res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 14424 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365378.600118:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbad8a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3311:1874188024516864:0@lo:103:ldlm_bl.0 00000100:00100000:1.0:1787365378.622455:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bc850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+18:15808:x1874188024516608:12345-0@lo:253:mount.lustre.0 Request processed in 45922us (47578us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365378.622470:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 71 00000100:00100000:3.0:1787365378.629824:0:15808:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf90380 pname:cluuid:pid:xid:nid:opc:job mount.lustre:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:15808:1874188024516608:0@lo:253:mount.lustre.0 10000000:01000000:3.0:1787365378.629843:0:15808:0:(mgc_request_server.c:302:mgc_target_register()) register lustre-OST0001 got index = 1 00000020:01000004:3.0:1787365378.629847:0:15808:0:(tgt_mount.c:1175:server_mti_print()) mti - mgc_target_register: rep 00000020:01000004:3.0:1787365378.629848:0:15808:0:(tgt_mount.c:1176:server_mti_print()) server: lustre-OST0001 00000020:01000004:3.0:1787365378.629849:0:15808:0:(tgt_mount.c:1177:server_mti_print()) fs: lustre 00000020:01000004:3.0:1787365378.629851:0:15808:0:(tgt_mount.c:1178:server_mti_print()) uuid: 00000020:01000004:3.0:1787365378.629852:0:15808:0:(tgt_mount.c:1179:server_mti_print()) ver: 0 00000020:01000004:3.0:1787365378.629853:0:15808:0:(tgt_mount.c:1180:server_mti_print()) flags: 00000020:01000004:3.0:1787365378.629855:0:15808:0:(tgt_mount.c:1184:server_mti_print()) LDD_F_SV_TYPE_OST 00000020:01000004:3.0:1787365378.629857:0:15808:0:(tgt_mount.c:1214:server_mti_print()) LDD_F_LARGE_NID 00000020:01000004:3.0:1787365378.629858:0:15808:0:(tgt_mount.c:1220:server_mti_print()) LDD_F_OPC_READY 00000020:02000000:3.0:1787365378.629874:0:15808:0:(tgt_mount.c:2692:server_calc_timeout()) lustre-OST0001: Imperative Recovery not enabled, recovery window 60-180 00080000:10000000:0.0:1787365378.638235:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x5:0x0] (8/8/4) registered 00080000:10000000:0.0:1787365378.638456:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x1:0x0] (8/8/1) registered 00080000:10000000:0.0:1787365378.638835:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x6:0x0] (8/8/4) registered 00080000:10000000:0.0:1787365378.639078:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x2:0x0] (8/8/1) registered 00080000:10000000:0.0:1787365378.639227:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000003:0x7:0x0] (8/8/4) registered 00080000:10000000:0.0:1787365378.639570:0:15808:0:(osd_index.c:2103:osd_index_try()) lustre-OST0001: index object [0x200000005:0x3:0x0] (8/8/1) registered 00000001:00000004:0.0:1787365378.642856:0:15808:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934592 00002000:00080000:2.0:1787365378.735424:0:15808:0:(ofd_obd.c:539:ofd_postrecov()) lustre-OST0001: recovery is over 00100000:10000000:2.0:1787365378.735434:0:15808:0:(lfsck_lib.c:3085:lfsck_start()) lustre-OST0001-osd: start master thread 00000020:01000004:2.0:1787365378.735464:0:15808:0:(tgt_mount.c:298:server_mgc_clear_fs()) Unassign mgc disk 10000000:01000000:2.0:1787365378.735514:0:15808:0:(mgc_request_server.c:166:mgc_fs_clear()) MGC192.168.203.113@tcp: cl_mgc_mutex unlock 00000020:01000004:2.0:1787365378.735525:0:15808:0:(tgt_mount.c:2458:server_fill_super_common()) Server sb, dev=49 00000080:00000004:2.0:1787365378.735560:0:15808:0:(super25.c:182:lustre_fill_super()) lustre-ost2/ost2: Mount complete 00010000:00010000:2.0:1787365378.764760:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365379.448183:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787365379.448206:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279809ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024516992:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787365379.448274:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365379.448349:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024516992 00000100:00100000:0.0:1787365379.448356:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024516992 00000100:00100000:0.0:1787365379.448400:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787365379.448409:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279809b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024516992:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787365379.448458:0:15095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787365379.448504:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279809b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024516992:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (229us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365379.448511:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:0.0:1787365379.448556:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279809ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024516992:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787365379.762797:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 10000000:01000000:1.0:1787365380.147722:0:14405:0:(mgc_request.c:611:do_requeue()) updating log lustre-mdtir 10000000:01000000:1.0:1787365380.147737:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log lustre-mdtir-ffff9f27b63ba000 from 8 10000000:01000000:1.0:1787365380.147742:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for lustre-mdtir (res 0x65727473756c) 00010000:00010000:1.0:1787365380.147784:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2798115200/0x872d29295eb47f5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365380.147796:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2798115200/0x872d29295eb47f5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365380.147808:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2798115200/0x872d29295eb47f5d lrc: 3/1,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365380.147833:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb408a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024517120:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787365380.147896:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365380.147952:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abf94600 going to sleep for 11 seconds 00000100:00100000:2.0:1787365380.148023:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024517120 00000100:00100000:2.0:1787365380.148030:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024517120 00000100:00100000:2.0:1787365380.148122:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 72 00000100:00100000:2.0:1787365380.148131:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+18:14405:x1874188024517120:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787365380.148143:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365380.148156:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a12cdc00/0x872d29295eb47f64 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb47f5d expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365380.148178:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a12cdc00/0x872d29295eb47f64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb47f5d expref: 19 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365380.148188:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a12cdc00/0x872d29295eb47f64 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47f5d expref: 19 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365380.148195:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cdc00, rc 0) 00000100:00100000:2.0:1787365380.148250:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bf850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:14405:x1874188024517120:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 121us (353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365380.148257:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 72 00000100:00100000:1.0:1787365380.148431:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb408a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024517120:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787365380.148446:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2798115200/0x872d29295eb47f5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47f64 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365380.148455:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2798115200/0x872d29295eb47f5d lrc: 4/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb47f64 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365380.148505:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb408a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024517248:0@lo:256:ll_cfg_requeue.0 00000100:00100000:1.0:1787365380.148535:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365380.152691:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27abf94600 going to sleep for 11 seconds 00000100:00100000:2.0:1787365380.155656:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024517248 00000100:00100000:2.0:1787365380.155670:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024517248 00000100:00100000:2.0:1787365380.155715:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 73 00000100:00100000:2.0:1787365380.155723:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:14405:x1874188024517248:12345-0@lo:256:ll_cfg_requeue.0 20000000:01000000:2.0:1787365380.155747:0:14401:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-mdtir bufsize 16384. 20000000:01000000:2.0:1787365380.155769:0:14401:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/4/3. 20000000:01000000:2.0:1787365380.155772:0:14401:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 44, version 8 00000100:00100000:2.0:1787365380.155896:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65be050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:14405:x1874188024517248:12345-0@lo:256:ll_cfg_requeue.0 Request processed in 173us (7359us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365380.155919:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 73 00000100:00100000:1.0:1787365380.156944:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb408a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024517248:0@lo:256:ll_cfg_requeue.0 10000000:01000000:1.0:1787365380.157024:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'lustre-mdtir' succeeded (0). 00010000:00010000:1.0:1787365380.157033:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2798115200/0x872d29295eb47f5d lrc: 3/1,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47f64 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365380.157059:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2798115200/0x872d29295eb47f5d lrc: 2/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb47f64 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365380.790415:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365381.813753:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000040:00080000:0.0:1787365382.259305:0:14442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00010000:00010000:1.0:1787365382.836335:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365383.860545:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00080000:3.0:1787365384.060373:0:12661:0:(pinger.c:229:ptlrpc_pinger_process_import()) lustre-MDT0000-mdtlov_UUID->lustre-OST0001_UUID: level DISCONN/3 force 0 force_next 0 deactive 0 pingable 0 suppress 1 00000100:00080000:3.0:1787365384.060381:0:12661:0:(pinger.c:237:ptlrpc_pinger_process_import()) lustre-OST0001_UUID: starting recovery 00000100:00080000:3.0:1787365384.060386:0:12661:0:(import.c:65:import_set_state_nolock()) ffff9f27bbae3800 lustre-OST0001_UUID: changing import state from DISCONN to CONNECTING 00000100:00080000:3.0:1787365384.060403:0:12661:0:(import.c:624:import_select_connection()) lustre-OST0001-osc-MDT0000: import ffff9f27bbae3800 using connection 192.168.203.113@tcp/0@lo 00000100:00100000:3.0:1787365384.060445:0:12661:0:(import.c:826:ptlrpc_connect_import_locked()) @@@ (re)connect request (timeout 5) req@ffff9f27baf93b80 x1874188024517632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/544 e 0 to 0 dl 0 ref 1 fl New:NQU/0/ffffffff rc 0/-1 job:'' uid:4294967295 gid:4294967295 projid:4294967295 00000100:00100000:3.0:1787365384.060524:0:3309:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024517632:0@lo:8:kworker.0 00000100:00100000:3.0:1787365384.060662:0:3309:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365384.060740:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024517760:0@lo:400:kworker.0 00000100:00100000:3.0:1787365384.060775:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365384.060795:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787365384.060800:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024517888:0@lo:400:kworker.0 00000100:00100000:3.0:1787365384.060820:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365384.060856:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024517760 00000100:00100000:3.0:1787365384.060864:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024517760 00000100:00100000:3.0:1787365384.060911:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024517888 00000100:00100000:3.0:1787365384.060914:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024517888 00000100:00100000:3.0:1787365384.060951:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787365384.060960:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024517760:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365384.061018:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf90a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3310:x1874188024517760:12345-0@lo:400:kworker.0 Request processed in 58us (243us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365384.061026:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:3.0:1787365384.061045:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787365384.061051:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024517888:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365384.061080:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf93480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024517888:12345-0@lo:400:kworker.0 Request processed in 30us (259us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365384.061086:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00080000:3.0:1787365384.061106:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:3.0:1787365384.061135:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27baf90700 x1874188024517888/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365384.061149:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024517888:0@lo:400:kworker.0 00000100:00100000:2.0:1787365384.061149:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3312:1874188024517376:0@lo:400:kworker.0 00010000:00080000:3.0:1787365384.061161:0:3310:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27baf91880 x1874188024517760/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:3.0:1787365384.061183:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-MDT0000_UUID:3310:1874188024517760:0@lo:400:kworker.0 00000100:00100000:2.0:1787365384.061314:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365384.061348:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024518016:0@lo:400:kworker.0 00000100:00100000:2.0:1787365384.061373:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365384.061389:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787365384.061394:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024517504:0@lo:400:kworker.0 00000100:00100000:2.0:1787365384.061415:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365384.061446:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024517632 00000100:00100000:2.0:1787365384.061450:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024517632 00000100:00100000:2.0:1787365384.061471:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024517504 00000100:00100000:2.0:1787365384.061473:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024517504 00000100:00100000:2.0:1787365384.061498:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787365384.061504:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbadb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024517504:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365384.061539:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbadb800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024517504:12345-0@lo:400:kworker.0 Request processed in 35us (122us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365384.061545:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787365384.061557:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787365384.061562:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:3309:x1874188024517632:12345-0@lo:8:kworker.0 00010000:00080000:2.0:1787365384.061591:0:15091:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from lustre-MDT0000-mdtlov_UUID@0@lo t0 exp 0000000000000000 cur 501 last 0 00000020:00000080:2.0:1787365384.061639:0:15091:0:(genops.c:1385:class_connect()) connect: client lustre-MDT0000-mdtlov_UUID, cookie 0x872d29295eb47f6b 00002000:00100000:2.0:1787365384.061659:0:15091:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli lustre-MDT0000-mdtlov_UUID/ffff9f27b7812000 ocd_connect_flags: 0xa044401443000026 ocd_version: 211392e ocd_grant: 0 ocd_index: 1 ocd_group 0 00002000:00080000:2.0:1787365384.061664:0:15091:0:(ofd_obd.c:139:ofd_parse_connect_data()) lustre-OST0001: Received MDS connection for group 0 00002000:00100000:2.0:1787365384.061667:0:15091:0:(ofd_obd.c:227:ofd_parse_connect_data()) lustre-OST0001: cli does not support OBD_CONNECT_CKSUM 00000100:00100000:1.0:1787365384.061971:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024518016 00000100:00100000:1.0:1787365384.061976:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024518016 00000100:00100000:1.0:1787365384.062032:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:1.0:1787365384.062040:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024518016:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365384.062081:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024518016:12345-0@lo:400:kworker.0 Request processed in 42us (706us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365384.062087:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787365384.062177:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024517376 00000100:00100000:3.0:1787365384.062182:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024517376 00000100:00100000:3.0:1787365384.062211:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 74 00000100:00100000:3.0:1787365384.062218:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:3312:x1874188024517376:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365384.062263:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bec50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:3312:x1874188024517376:12345-0@lo:400:kworker.0 Request processed in 45us (1073us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365384.062269:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 74 00000100:00080000:3.0:1787365384.062297:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:3.0:1787365384.062300:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00002000:00080000:2.0:1787365384.062593:0:15091:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:2.0:1787365384.062653:0:15091:0:(import.c:65:import_set_state_nolock()) ffff9f27b7817800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787365384.062710:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf92a00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:3309:x1874188024517632:12345-0@lo:8:kworker.0 Request processed in 1145us (2047us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365384.062719:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:2.0:1787365384.062770:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf91c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024517504:0@lo:400:kworker.0 00000100:00100000:2.0:1787365384.062781:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf90380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3312:1874188024517376:0@lo:400:kworker.0 00010000:00080000:2.0:1787365384.062795:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27baf93100 x1874188024518016/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365400 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365384.062806:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024518016:0@lo:400:kworker.0 00010000:00080000:3.0:1787365384.066485:0:3309:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27baf93b80 x1874188024517632/t0(0) o8->lustre-OST0001-osc-MDT0000@0@lo:28/4 lens 520/416 e 0 to 0 dl 1787365409 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00080000:3.0:1787365384.066513:0:3309:0:(import.c:1132:ptlrpc_connect_interpret()) lustre-OST0001-osc-MDT0000: connect to target with instance 2 00000100:00080000:3.0:1787365384.066526:0:3309:0:(import.c:956:ptlrpc_connect_set_flags()) lustre-OST0001-osc-MDT0000: Resetting ns_connect_flags to server flags: 0xa040401443000026 00000100:00080000:3.0:1787365384.066534:0:3309:0:(import.c:1213:ptlrpc_connect_interpret()) connected to replayable target: lustre-OST0001_UUID 00000100:00080000:3.0:1787365384.066538:0:3309:0:(import.c:65:import_set_state_nolock()) ffff9f27bbae3800 lustre-OST0001_UUID: changing import state from CONNECTING to FULL 00000004:00080000:3.0:1787365384.066572:0:3309:0:(osp_dev.c:1648:osp_import_event()) got connected 00000100:00100000:3.0:1787365384.066580:0:3309:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf93b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_rcv:lustre-MDT0000-mdtlov_UUID:3309:1874188024517632:0@lo:8:kworker.0 00000004:00080000:3.0:1787365384.066660:0:14432:0:(osp_sync.c:1045:osp_sync_process_record()) processed all old entries 00000004:00080000:3.0:1787365384.067223:0:14432:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 501231596504ns, next at 0ns, rc = 0 00000004:00080000:0.0:1787365384.078763:0:14433:0:(osp_precreate.c:882:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: going to cleanup orphans since [0x280000400:0x6:0x0] 00000100:00100000:0.0:1787365384.078804:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2798099180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14433:1874188024518272:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787365384.078892:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365384.078935:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2787828300 going to sleep for 11 seconds 00000100:00100000:0.0:1787365384.078954:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:0.0:1787365384.078969:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279809ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024518144:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787365384.078997:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365384.079036:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024518272 00000100:00100000:0.0:1787365384.079044:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024518272 00000100:00100000:0.0:1787365384.079110:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787365384.079121:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279809a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14433:x1874188024518272:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787365384.081834:0:15091:0:(ofd_fs.c:432:ofd_seq_load()) lustre-OST0001: adding sequence 0x280000400 00002000:00080000:0.0:1787365384.081849:0:15091:0:(ofd_dev.c:1640:ofd_create_hdl()) ofd_last_id() = 33 -> diff = -27 00002000:02000040:0.0:1787365384.081856:0:15091:0:(ofd_dev.c:1491:ofd_orphans_destroy()) lustre-OST0001: new connection from lustre-MDT0000-mdtlov (cleaning up unused objects from 0x280000400:7 to 0x280000400:33) 00000100:00080000:3.0:1787365384.084030:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787365384.088570:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024518144 00000100:00100000:3.0:1787365384.088589:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024518144 00000100:00100000:3.0:1787365384.089668:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:3.0:1787365384.089688:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874188024518144:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787365384.089752:0:15095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40960000 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365384.090541:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798098700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3312:x1874188024518144:12345-0@lo:13:osp-pre-1-0.0 Request processed in 855us (11537us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365384.090554:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00010000:00080000:2.0:1787365384.097175:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f279809ad80 x1874188024518144/t0(0) o13->lustre-OST0001-osc-MDT0000@0@lo:7/4 lens 224/368 e 0 to 0 dl 1787365400 ref 1 fl Rpc:RQU/200/0 rc 0/0 job:'osp-pre-1-0.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365384.099770:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279809ad80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024518144:0@lo:13:osp-pre-1-0.0 00002000:00010000:0.0:1787365384.103557:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x21:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365384.103579:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47f72 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.103602:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787365384.103608:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x21:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365384.103664:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47f72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.103691:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47f72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.103704:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47f72 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.103712:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47f72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.120964:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:0.0:1787365384.120999:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365384.121011:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47f72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.121029:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e22800 already unused, calling callback (ffffffffc1672420) 00010000:00010000:0.0:1787365384.121035:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47f72 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.121051:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47f72 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.121082:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47f72 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.121109:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47f72 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x21:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.121133:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365384.121136:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365384.121138:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787365384.129299:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x20:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365384.129321:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47f79 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.129345:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787365384.129351:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x20:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365384.129358:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47f79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.129377:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47f79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.129389:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47f79 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.129399:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47f79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.129423:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787365384.129779:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365384.129790:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47f79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365384.129801:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e23e00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365384.129806:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47f79 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365384.129818:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47f79 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365384.129850:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47f79 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365384.129858:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47f79 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x20:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365384.129886:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365384.129888:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365384.129890:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787365384.130365:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1f:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365384.130380:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47f80 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.130391:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787365384.130395:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1f:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365384.130399:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47f80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.130409:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47f80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.130417:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47f80 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.130424:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47f80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.130451:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787365384.130506:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365384.130515:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47f80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.130524:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e22200 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365384.130528:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47f80 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.130537:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47f80 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.130555:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47f80 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.130581:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47f80 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1f:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.130603:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.130605:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.130607:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787365384.131066:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1e:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365384.131073:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47f87 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.131081:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787365384.131085:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1e:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365384.131089:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.131098:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.131113:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47f87 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.131121:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.131136:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787365384.131572:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1d:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365384.131579:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47f8e lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.131589:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787365384.131592:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1d:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365384.131596:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47f8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.131605:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47f8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.131612:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47f8e lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.131618:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47f8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.138976:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:3.0:1787365384.142809:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:3.0:1787365384.142829:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365384.142862:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e22000 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365384.142868:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47f87 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365384.142881:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47f87 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365384.142908:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47f87 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365384.142917:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47f87 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1e:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365384.142941:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365384.142945:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47f8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365384.142951:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e22e00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365384.142955:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47f8e lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365384.142963:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47f8e lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365384.142974:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47f8e lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365384.142987:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47f8e lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1d:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365384.143001:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365384.143003:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365384.143005:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787365384.147431:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1c:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365384.147446:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47f95 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.147468:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787365384.147473:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1c:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365384.147481:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47f95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.147497:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47f95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.147509:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47f95 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.147518:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47f95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.147538:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:3.0:1787365384.147836:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:3.0:1787365384.147846:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47f95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365384.147857:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e22800 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365384.147862:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47f95 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365384.147873:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47f95 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365384.147896:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47f95 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365384.147905:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb47f95 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1c:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365384.147934:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365384.147937:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365384.147939:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787365384.148047:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1b:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365384.148053:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca249acf/0x872d29295eb47f9c lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.148061:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787365384.148071:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1b:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365384.148076:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca249acf/0x872d29295eb47f9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.148086:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca249acf/0x872d29295eb47f9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.148094:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca249acf/0x872d29295eb47f9c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.148101:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca249acf/0x872d29295eb47f9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.148122:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787365384.148524:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x1a:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365384.148530:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd2ba567/0x872d29295eb47fa3 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.148539:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787365384.148542:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x1a:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365384.148546:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd2ba567/0x872d29295eb47fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.148556:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd2ba567/0x872d29295eb47fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.148565:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd2ba567/0x872d29295eb47fa3 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.148580:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd2ba567/0x872d29295eb47fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.148588:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00002000:00010000:0.0:1787365384.149009:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x19:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365384.149016:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092c665cb/0x872d29295eb47faa lrc: 3/0,1 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.149025:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787365384.149028:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x19:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365384.149033:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092c665cb/0x872d29295eb47faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.149034:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787365384.149045:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca249acf/0x872d29295eb47f9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.149049:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092c665cb/0x872d29295eb47faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.149065:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e23200 already unused, calling callback (ffffffffc1672420) 00010000:00010000:0.0:1787365384.149068:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092c665cb/0x872d29295eb47faa lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.149072:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca249acf/0x872d29295eb47f9c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.149085:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092c665cb/0x872d29295eb47faa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.149090:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca249acf/0x872d29295eb47f9c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.149101:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787365384.149111:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca249acf/0x872d29295eb47f9c lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.149120:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca249acf/0x872d29295eb47f9c lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1b:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.149138:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787365384.149142:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd2ba567/0x872d29295eb47fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.149157:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e23a00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365384.149161:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd2ba567/0x872d29295eb47fa3 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.149169:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd2ba567/0x872d29295eb47fa3 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.149181:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd2ba567/0x872d29295eb47fa3 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.149278:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd2ba567/0x872d29295eb47fa3 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x1a:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.149294:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365384.149298:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092c665cb/0x872d29295eb47faa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.149305:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e23800 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365384.149308:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092c665cb/0x872d29295eb47faa lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.149316:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092c665cb/0x872d29295eb47faa lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.149327:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092c665cb/0x872d29295eb47faa lrc: 1/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.149341:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092c665cb/0x872d29295eb47faa lrc: 0/0,0 mode: --/PW res: [0x280000400:0x19:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.149356:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.149358:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.149360:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365384.150586:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787365384.156769:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x18:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365384.156789:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47fb1 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.156826:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787365384.156831:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x18:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365384.156840:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47fb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.156858:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47fb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.156870:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47fb1 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.156877:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47fb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.156903:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787365384.162573:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x17:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365384.162594:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47fb8 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.162616:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787365384.162650:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x17:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365384.162660:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.162678:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.162708:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47fb8 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.162717:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.162739:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787365384.162755:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787365384.162763:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47fb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.162772:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e22e00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:0.0:1787365384.162777:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47fb1 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.162787:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47fb1 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.162808:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47fb1 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.162816:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47fb1 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x18:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.162839:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365384.162850:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.162857:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e22000 already unused, calling callback (ffffffffc1672420) 00010000:00010000:0.0:1787365384.162861:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47fb8 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.162869:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47fb8 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.162881:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47fb8 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.162889:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47fb8 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x17:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.162902:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365384.162904:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365384.162906:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.163031:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000004:00080000:2.0:1787365384.165552:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 1 committed 00002000:00010000:1.0:1787365384.170234:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x16:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787365384.170259:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4ea2acc/0x872d29295eb47fbf lrc: 3/0,1 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.170290:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=501s v=(0 0) 00010000:00010000:1.0:1787365384.170295:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x16:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365384.170304:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d4ea2acc/0x872d29295eb47fbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.170321:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d4ea2acc/0x872d29295eb47fbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.170332:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d4ea2acc/0x872d29295eb47fbf lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.170339:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d4ea2acc/0x872d29295eb47fbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.170366:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:1.0:1787365384.170846:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x15:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787365384.170854:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000979dab3b/0x872d29295eb47fc6 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.170864:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=501s v=(0 0) 00010000:00010000:1.0:1787365384.170867:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x15:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365384.170872:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000979dab3b/0x872d29295eb47fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.170882:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000979dab3b/0x872d29295eb47fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.170890:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000979dab3b/0x872d29295eb47fc6 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.170897:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000979dab3b/0x872d29295eb47fc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.170912:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:1.0:1787365384.170930:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787365384.170936:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d4ea2acc/0x872d29295eb47fbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.170944:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114400 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365384.170950:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4ea2acc/0x872d29295eb47fbf lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.170971:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d4ea2acc/0x872d29295eb47fbf lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.170992:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d4ea2acc/0x872d29295eb47fbf lrc: 1/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.170999:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d4ea2acc/0x872d29295eb47fbf lrc: 0/0,0 mode: --/PW res: [0x280000400:0x16:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.171021:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365384.171025:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000979dab3b/0x872d29295eb47fc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.171031:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798115c00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365384.171035:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000979dab3b/0x872d29295eb47fc6 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.171042:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000979dab3b/0x872d29295eb47fc6 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.171050:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000979dab3b/0x872d29295eb47fc6 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.171057:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000979dab3b/0x872d29295eb47fc6 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x15:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.171081:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.171083:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.171085:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787365384.171502:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x14:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787365384.171506:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb47fcd lrc: 3/0,1 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.171513:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=501s v=(0 0) 00010000:00010000:1.0:1787365384.171516:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x14:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365384.171519:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb47fcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.171526:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb47fcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.171531:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb47fcd lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.171536:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb47fcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.171547:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787365384.171554:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365384.171557:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb47fcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.171576:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114200 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365384.171580:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb47fcd lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.171588:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb47fcd lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.171600:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb47fcd lrc: 1/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.171608:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb47fcd lrc: 0/0,0 mode: --/PW res: [0x280000400:0x14:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.171622:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.171647:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.171649:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:1.0:1787365384.172070:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x13:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:1.0:1787365384.172076:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002aaa7b01/0x872d29295eb47fd4 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.172085:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=501s v=(0 0) 00010000:00010000:1.0:1787365384.172087:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x13:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365384.172091:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002aaa7b01/0x872d29295eb47fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.172099:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002aaa7b01/0x872d29295eb47fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.172113:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002aaa7b01/0x872d29295eb47fd4 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.172120:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002aaa7b01/0x872d29295eb47fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.172134:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00010000:00010000:1.0:1787365384.172143:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365384.172146:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002aaa7b01/0x872d29295eb47fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.172153:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114c00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365384.172157:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002aaa7b01/0x872d29295eb47fd4 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.172165:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002aaa7b01/0x872d29295eb47fd4 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.172177:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002aaa7b01/0x872d29295eb47fd4 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.172185:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002aaa7b01/0x872d29295eb47fd4 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x13:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.172201:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.172209:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.172211:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365384.172914:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787365384.175037:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x12:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365384.175052:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47fdb lrc: 3/0,1 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.175083:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787365384.175089:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x12:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365384.175097:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47fdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.175315:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47fdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.175330:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47fdb lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.175337:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47fdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.175363:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787365384.175857:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x11:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365384.175864:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47fe2 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.175874:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787365384.175878:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x11:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365384.175883:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47fe2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.175893:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47fe2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.175902:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47fe2 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.175921:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.175943:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to regular blp list, 2 blwis in pool 00010000:00010000:0.0:1787365384.175962:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787365384.176832:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47fdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.176845:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e23e00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:0.0:1787365384.176851:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47fdb lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.176863:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47fdb lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.176888:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47fdb lrc: 1/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.176896:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000008c96469a/0x872d29295eb47fdb lrc: 0/0,0 mode: --/PW res: [0x280000400:0x12:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.176924:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365384.176928:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.176954:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e22200 already unused, calling callback (ffffffffc1672420) 00010000:00010000:0.0:1787365384.176957:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47fe2 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.177217:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47fe2 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.177232:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47fe2 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.177240:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003dd5c2b6/0x872d29295eb47fe2 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x11:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.177276:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365384.177279:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365384.177282:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.178101:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787365384.178372:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x10:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365384.178381:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de7a1cf5/0x872d29295eb47fe9 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.178398:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787365384.178402:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x10:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365384.178409:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000de7a1cf5/0x872d29295eb47fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.178422:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000de7a1cf5/0x872d29295eb47fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.178439:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000de7a1cf5/0x872d29295eb47fe9 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.178448:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000de7a1cf5/0x872d29295eb47fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.178513:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787365384.179053:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xf:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365384.179061:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030e2641a/0x872d29295eb47ff0 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.179081:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787365384.179085:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xf:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365384.179090:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000030e2641a/0x872d29295eb47ff0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.179100:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000030e2641a/0x872d29295eb47ff0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.179110:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000030e2641a/0x872d29295eb47ff0 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.179118:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000030e2641a/0x872d29295eb47ff0 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.179381:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787365384.179390:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000de7a1cf5/0x872d29295eb47fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.179400:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e23600 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365384.179405:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000de7a1cf5/0x872d29295eb47fe9 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.179414:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000de7a1cf5/0x872d29295eb47fe9 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.179433:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000de7a1cf5/0x872d29295eb47fe9 lrc: 1/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.179441:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000de7a1cf5/0x872d29295eb47fe9 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x10:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.179464:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365384.179467:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000030e2641a/0x872d29295eb47ff0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.179474:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e22600 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365384.179478:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000030e2641a/0x872d29295eb47ff0 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.179499:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000030e2641a/0x872d29295eb47ff0 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.179510:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000030e2641a/0x872d29295eb47ff0 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.179518:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.179520:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.179522:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365384.180542:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787365384.180559:0:15091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000030e2641a/0x872d29295eb47ff0 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xf:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787365384.181516:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xe:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365384.181527:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47ff7 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.181544:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787365384.181549:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xe:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365384.181556:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.181573:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.181584:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47ff7 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.181592:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47ff7 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.183062:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365384.183207:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47ff7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.183223:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e22000 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365384.183228:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47ff7 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.183239:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47ff7 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.183342:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47ff7 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.183359:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.183360:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.183363:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365384.183474:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787365384.183483:0:15091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000403db2b7/0x872d29295eb47ff7 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xe:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787365384.184919:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xd:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365384.184932:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47ffe lrc: 3/0,1 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.184950:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787365384.184956:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xd:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365384.185196:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47ffe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.185216:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47ffe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.185228:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47ffe lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.185238:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47ffe lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.186059:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365384.186073:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47ffe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.186228:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e22e00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365384.186237:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47ffe lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.186259:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47ffe lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.186487:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47ffe lrc: 2/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.186502:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.186504:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.186507:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365384.186869:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787365384.186879:0:15091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000338762c3/0x872d29295eb47ffe lrc: 0/0,0 mode: --/PW res: [0x280000400:0xd:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787365384.188732:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xc:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365384.188748:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092c665cb/0x872d29295eb48005 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.188778:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787365384.188783:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xc:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365384.188791:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000092c665cb/0x872d29295eb48005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.188807:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000092c665cb/0x872d29295eb48005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.188819:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000092c665cb/0x872d29295eb48005 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.188826:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000092c665cb/0x872d29295eb48005 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.189593:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365384.189604:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000092c665cb/0x872d29295eb48005 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.189615:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e23800 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365384.189620:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000092c665cb/0x872d29295eb48005 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.189641:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000092c665cb/0x872d29295eb48005 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.189677:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000092c665cb/0x872d29295eb48005 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.189689:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.189691:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.189693:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365384.189789:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787365384.189796:0:15091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000092c665cb/0x872d29295eb48005 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xc:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.190040:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:0.0:1787365384.191829:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xb:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365384.191844:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd2ba567/0x872d29295eb4800c lrc: 3/0,1 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.191863:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787365384.191868:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xb:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365384.191875:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000bd2ba567/0x872d29295eb4800c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.191903:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000bd2ba567/0x872d29295eb4800c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.191915:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000bd2ba567/0x872d29295eb4800c lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.191923:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000bd2ba567/0x872d29295eb4800c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.192037:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00002000:00010000:0.0:1787365384.192783:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0xa:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365384.192792:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca249acf/0x872d29295eb48013 lrc: 3/0,1 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.192804:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787365384.192808:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0xa:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365384.192813:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ca249acf/0x872d29295eb48013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.192824:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ca249acf/0x872d29295eb48013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.192832:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ca249acf/0x872d29295eb48013 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.192851:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ca249acf/0x872d29295eb48013 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.193394:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:1.0:1787365384.193406:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000bd2ba567/0x872d29295eb4800c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.193417:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e23a00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365384.193422:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd2ba567/0x872d29295eb4800c lrc: 2/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.193433:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000bd2ba567/0x872d29295eb4800c lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.193454:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000bd2ba567/0x872d29295eb4800c lrc: 1/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.193462:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000bd2ba567/0x872d29295eb4800c lrc: 0/0,0 mode: --/PW res: [0x280000400:0xb:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.193488:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365384.193492:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ca249acf/0x872d29295eb48013 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.193507:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e23200 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365384.193511:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca249acf/0x872d29295eb48013 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.193519:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ca249acf/0x872d29295eb48013 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.193530:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ca249acf/0x872d29295eb48013 lrc: 2/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.193539:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.193541:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.193543:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365384.193614:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787365384.193621:0:15091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ca249acf/0x872d29295eb48013 lrc: 0/0,0 mode: --/PW res: [0x280000400:0xa:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787365384.194454:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x9:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365384.194463:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb4801a lrc: 3/0,1 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.194476:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787365384.194481:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x9:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365384.194488:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb4801a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.194500:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb4801a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.194510:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb4801a lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.194518:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb4801a lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.195407:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365384.195420:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb4801a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.195432:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27b6e22800 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365384.195436:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb4801a lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.195445:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb4801a lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.195464:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb4801a lrc: 2/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.195484:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.195486:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.195488:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365384.195614:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787365384.195622:0:15091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000003d24f75f/0x872d29295eb4801a lrc: 0/0,0 mode: --/PW res: [0x280000400:0x9:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787365384.196905:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x8:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365384.196917:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000885a60a6/0x872d29295eb48021 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.196936:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787365384.196942:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x8:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365384.196950:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000885a60a6/0x872d29295eb48021 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.196965:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000885a60a6/0x872d29295eb48021 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.197050:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000885a60a6/0x872d29295eb48021 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.197059:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000885a60a6/0x872d29295eb48021 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.197402:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365384.197410:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000885a60a6/0x872d29295eb48021 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.197420:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2044400 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365384.197424:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000885a60a6/0x872d29295eb48021 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.197435:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000885a60a6/0x872d29295eb48021 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.197453:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000885a60a6/0x872d29295eb48021 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.197465:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.197467:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.197469:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365384.197538:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787365384.197545:0:15091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000885a60a6/0x872d29295eb48021 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x8:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:0.0:1787365384.198472:0:15091:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x7:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x0, blocks: 0x1 00010000:00010000:0.0:1787365384.198482:0:15091:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37b7148/0x872d29295eb48028 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.198496:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=501s v=(0 0) 00010000:00010000:0.0:1787365384.198500:0:15091:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x7:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365384.198506:0:15091:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000d37b7148/0x872d29295eb48028 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.198519:0:15091:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000d37b7148/0x872d29295eb48028 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.198529:0:15091:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000d37b7148/0x872d29295eb48028 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010080000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365384.198538:0:15091:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000d37b7148/0x872d29295eb48028 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.198661:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:1.0:1787365384.198668:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000d37b7148/0x872d29295eb48028 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.198676:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2044000 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365384.198680:0:14396:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37b7148/0x872d29295eb48028 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.198698:0:14396:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000d37b7148/0x872d29295eb48028 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.198714:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000d37b7148/0x872d29295eb48028 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365384.198724:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.198726:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365384.198728:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365384.198794:0:15091:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/0 locks to regular blp list, 0 blwis in pool 00010000:00010000:0.0:1787365384.198800:0:15091:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000d37b7148/0x872d29295eb48028 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x7:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819480000000 nid: local remote: 0x0 expref: -99 pid: 15091 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00080000:0.0:1787365384.199348:0:15091:0:(ofd_dev.c:1518:ofd_orphans_destroy()) lustre-OST0001: after destroy: set last_id to 0x280000400:6 00000100:00100000:0.0:1787365384.199477:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279809a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14433:x1874188024518272:12345-0@lo:5:osp-pre-1-0.0 Request processed in 120352us (120580us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365384.199500:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787365384.199574:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2798099180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14433:1874188024518272:0@lo:5:osp-pre-1-0.0 00000004:00080000:0.0:1787365384.199597:0:14433:0:(osp_precreate.c:960:osp_precreate_cleanup_orphans()) lustre-OST0001-osc-MDT0000: Got last_id [0x280000400:0x21:0x0] from OST, last_created [0x280000400:0x21:0x0]last_used is [0x280000400:0x6:0x0] 00010000:00010000:1.0:1787365384.199682:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365384.199784:0:14433:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2798099180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14433:1874188024518400:0@lo:5:osp-pre-1-0.0 00000100:00100000:0.0:1787365384.199828:0:14433:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365384.199883:0:14433:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2784c7f6c0 going to sleep for 11 seconds 00000100:00100000:0.0:1787365384.199902:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024518400 00000100:00100000:0.0:1787365384.199909:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024518400 00000100:00100000:0.0:1787365384.199953:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 7 00000100:00100000:0.0:1787365384.199962:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279809ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+6:14433:x1874188024518400:12345-0@lo:5:osp-pre-1-0.0 00002000:00080000:0.0:1787365384.200613:0:15091:0:(ofd_dev.c:1747:ofd_create_hdl()) lustre-OST0001: reserve 32 objects in group 0x280000400 at 34 00000100:00100000:0.0:1787365384.212925:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279809ad80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+7:14433:x1874188024518400:12345-0@lo:5:osp-pre-1-0.0 Request processed in 12953us (13086us total) trans 8589934593 rc 0/0 00000100:00100000:0.0:1787365384.212942:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 7 00000100:00100000:1.0:1787365384.213437:0:14433:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2798099180 pname:cluuid:pid:xid:nid:opc:job osp-pre-1-0:lustre-MDT0000-mdtlov_UUID:14433:1874188024518400:0@lo:5:osp-pre-1-0.0 00000004:00080000:1.0:1787365384.213461:0:14433:0:(osp_precreate.c:705:osp_precreate_send()) lustre-OST0001-osc-MDT0000: current precreated pool: [0x280000400:0x21:0x0]-[0x280000400:0x41:0x0] 00000100:00100000:3.0:1787365384.565231:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2798099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024518528:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787365384.565375:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365384.566370:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024518528 00000100:00100000:2.0:1787365384.566386:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024518528 00000100:00100000:2.0:1787365384.566443:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787365384.566454:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024518528:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:2.0:1787365384.566503:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365384.566580:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf93b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024518528:12345-0@lo:13:osp-pre-0-0.0 Request processed in 128us (1207us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365384.566589:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:3.0:1787365384.566709:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2798099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024518528:0@lo:13:osp-pre-0-0.0 00010000:00010000:3.0:1787365384.883165:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365385.906988:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787365386.237560:0:16168:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: oleg313-server.virtnet: executing set_default_debug vfstrace rpctrace dlmtrace neterror ha config ioctl super lfsck all 00010000:00010000:3.0:1787365386.931946:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365387.955927:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365388.981594:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365389.171144:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:1.0:1787365389.171185:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024518656:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365389.171287:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365389.172398:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024518656 00000100:00100000:2.0:1787365389.172412:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024518656 00000100:00100000:2.0:1787365389.172501:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787365389.172536:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb40a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874188024518656:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:2.0:1787365389.172587:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 40828928 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365389.172690:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb40a680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+7:3310:x1874188024518656:12345-0@lo:13:osp-pre-1-0.0 Request processed in 158us (1402us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365389.172700:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:2.0:1787365389.172994:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024518656:0@lo:13:osp-pre-1-0.0 00000100:00080000:0.0:1787365389.174221:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787365389.176032:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3312:1874188024518784:0@lo:400:kworker.0 00000100:00100000:2.0:1787365389.176128:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365389.176178:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024519296:0@lo:400:kworker.0 00000100:00100000:2.0:1787365389.176220:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365389.176252:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787365389.176258:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024518912:0@lo:400:kworker.0 00000100:00100000:2.0:1787365389.176289:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365389.176324:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024519168:0@lo:400:kworker.0 00000100:00100000:2.0:1787365389.176350:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365389.176373:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:2.0:1787365389.176379:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024519040:0@lo:400:kworker.0 00000100:00100000:2.0:1787365389.176402:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365389.176433:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024518784 00000100:00100000:2.0:1787365389.176441:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024518784 00000100:00100000:2.0:1787365389.176498:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787365389.176507:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:3312:x1874188024518784:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365389.176566:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bc050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:3312:x1874188024518784:12345-0@lo:400:kworker.0 Request processed in 60us (438us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365389.176575:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 75 00000100:00100000:2.0:1787365389.176655:0:15822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024519296 00000100:00100000:2.0:1787365389.176659:0:15822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024519296 00000100:00100000:2.0:1787365389.176699:0:15822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024519168 00000100:00100000:2.0:1787365389.176702:0:15822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024519168 00000100:00100000:2.0:1787365389.176717:0:15822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024519040 00000100:00100000:2.0:1787365389.176720:0:15822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024519040 00000100:00100000:2.0:1787365389.176732:0:15822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787365389.176739:0:15822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024519296:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365389.176775:0:15822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad8e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3312:x1874188024519296:12345-0@lo:400:kworker.0 Request processed in 37us (564us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365389.176782:0:15822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:2.0:1787365389.176794:0:15822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787365389.176800:0:15822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024519168:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365389.176830:0:15822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808d880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024519168:12345-0@lo:400:kworker.0 Request processed in 30us (479us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365389.176836:0:15822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:2.0:1787365389.176847:0:15822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787365389.176853:0:15822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024519040:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365389.176880:0:15822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-MDT0000_UUID+5:3311:x1874188024519040:12345-0@lo:400:kworker.0 Request processed in 27us (477us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365389.176886:0:15822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787365389.176911:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024518912 00000100:00100000:2.0:1787365389.176914:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024518912 00000100:00100000:2.0:1787365389.176957:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 2 00000100:00100000:2.0:1787365389.176964:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024518912:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365389.176997:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024518912:12345-0@lo:400:kworker.0 Request processed in 34us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365389.177016:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 2 00000100:00080000:2.0:1787365389.177052:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787365389.177057:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00080000:2.0:1787365389.177099:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27baf92d80 x1874188024519040/t0(0) o400->lustre-MDT0000-lwp-MDT0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365389.177114:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-MDT0000_UUID:3311:1874188024519040:0@lo:400:kworker.0 00010000:00080000:2.0:1787365389.177125:0:3311:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27baf92680 x1874188024519168/t0(0) o400->lustre-MDT0000-lwp-OST0000@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365389.177133:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf92680 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024519168:0@lo:400:kworker.0 00000100:00100000:2.0:1787365389.177167:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf90700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024518912:0@lo:400:kworker.0 00000100:00100000:2.0:1787365389.177176:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf91880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3312:1874188024518784:0@lo:400:kworker.0 00010000:00080000:2.0:1787365389.177186:0:3312:0:(ldlm_request.c:1671:ldlm_cli_update_pool()) @@@ Zero SLV or limit found (SLV=0, limit=61549) req@ffff9f27baf93100 x1874188024519296/t0(0) o400->lustre-MDT0000-lwp-OST0001@0@lo:12/10 lens 224/224 e 0 to 0 dl 1787365405 ref 1 fl Rpc:RNQU/200/0 rc 0/0 job:'kworker.0' uid:0 gid:0 projid:4294967295 00000100:00100000:2.0:1787365389.177195:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0001_UUID:3312:1874188024519296:0@lo:400:kworker.0 00000100:00100000:3.0:1787365389.312144:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365389.312176:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003550208 00000100:00100000:3.0:1787365389.312185:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003550208 00000100:00100000:3.0:1787365389.312240:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:3.0:1787365389.312247:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:0+-99:2358:x1874188003550208:12345-192.168.203.13@tcp:250:mount.lustre.0 00010000:00080000:3.0:1787365389.312273:0:14403:0:(ldlm_lib.c:1444:target_handle_connect()) MGS: connection from fe404169-601c-4b3f-a2f6-d9e3817a2d0c@192.168.203.13@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:3.0:1787365389.312302:0:14403:0:(genops.c:1385:class_connect()) connect: client fe404169-601c-4b3f-a2f6-d9e3817a2d0c, cookie 0x872d29295eb4802f 00000100:00080000:3.0:1787365389.312486:0:14403:0:(import.c:65:import_set_state_nolock()) ffff9f268673d800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787365389.312551:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bcc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+5:2358:x1874188003550208:12345-192.168.203.13@tcp:250:mount.lustre.0 Request processed in 302us (414us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365389.312559:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 76 00000100:00100000:2.0:1787365389.321124:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365389.321170:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003550336 00000100:00100000:2.0:1787365389.321181:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003550336 00000100:00100000:2.0:1787365389.321782:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:2.0:1787365389.321797:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+5:13759:x1874188003550336:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787365389.321819:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365389.321843:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a12cc000/0x872d29295eb48036 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989893bc expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365389.321896:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a12cc000/0x872d29295eb48036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989893bc expref: 6 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365389.321909:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a12cc000/0x872d29295eb48036 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 9 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989893bc expref: 6 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365389.321920:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cc000, rc 0) 00000100:00100000:2.0:1787365389.322054:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bd450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+6:13759:x1874188003550336:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 261us (941us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365389.322062:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 77 00000100:00100000:1.0:1787365389.355660:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365389.356545:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003550464 00000100:00100000:3.0:1787365389.356559:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003550464 00000100:00100000:3.0:1787365389.357571:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:3.0:1787365389.357589:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+6:13759:x1874188003550464:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787365389.358999:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65be850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+6:13759:x1874188003550464:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 1410us (3365us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787365389.359011:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 78 00000100:00100000:2.0:1787365389.365955:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365389.366015:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003550592 00000100:00100000:3.0:1787365389.366030:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003550592 00000100:00100000:3.0:1787365389.366095:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:3.0:1787365389.366104:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+6:13759:x1874188003550592:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787365389.366119:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365389.366135:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2788f44c00/0x872d29295eb4803d lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989893c3 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365389.366164:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2788f44c00/0x872d29295eb4803d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989893c3 expref: 7 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365389.366176:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2788f44c00/0x872d29295eb4803d lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 10 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989893c3 expref: 7 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365389.366185:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44c00, rc 0) 00000100:00100000:3.0:1787365389.366275:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bfc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+7:13759:x1874188003550592:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 168us (330us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365389.366287:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 79 00000100:00100000:1.0:1787365389.373709:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365389.374315:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003550720 00000100:00100000:3.0:1787365389.374330:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003550720 00000100:00100000:3.0:1787365389.374400:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:3.0:1787365389.374414:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+7:13759:x1874188003550720:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787365389.375119:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bd050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+8:13759:x1874188003550720:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 707us (1421us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365389.375128:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 80 00000100:00100000:3.0:1787365389.379156:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365389.379183:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003550848 00000100:00100000:3.0:1787365389.379198:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003550848 00000100:00100000:3.0:1787365389.379248:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:3.0:1787365389.379255:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+8:13759:x1874188003550848:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787365389.379446:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bb450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+8:13759:x1874188003550848:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 190us (299us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365389.379453:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 81 00000100:00100000:2.0:1787365389.396812:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365389.397105:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003550976 00000100:00100000:3.0:1787365389.397119:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003550976 00000100:00100000:3.0:1787365389.397197:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 82 00000100:00100000:3.0:1787365389.397219:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+8:13777:x1874188003550976:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787365389.397573:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bb050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+8:13777:x1874188003550976:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 364us (775us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365389.397581:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 82 00000001:00080000:1.0:1787365389.404760:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934593 is committed 00000001:00100000:1.0:1787365389.404822:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of lustre-MDT0000-mdtlov_UUID 00000100:00100000:3.0:1787365389.431609:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365389.432566:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003551104 00000100:00100000:0.0:1787365389.432583:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003551104 00000100:00100000:0.0:1787365389.432688:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:0.0:1787365389.432700:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+8:13777:x1874188003551104:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787365389.433066:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65b9c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+8:13777:x1874188003551104:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 367us (1468us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365389.433075:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 83 00000100:00100000:1.0:1787365389.453985:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365389.454116:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003551232 00000100:00100000:2.0:1787365389.454130:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003551232 00000100:00100000:2.0:1787365389.454202:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:2.0:1787365389.454225:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+8:13759:x1874188003551232:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:2.0:1787365389.454247:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365389.454271:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a12cc400/0x872d29295eb48044 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989893ed expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365389.454309:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a12cc400/0x872d29295eb48044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989893ed expref: 9 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365389.454322:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a12cc400/0x872d29295eb48044 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989893ed expref: 9 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365389.454332:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cc400, rc 0) 00000100:00100000:2.0:1787365389.454423:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65b8850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+9:13759:x1874188003551232:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 202us (454us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365389.454432:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 84 00000100:00100000:1.0:1787365389.468483:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365389.469082:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003551360 00000100:00100000:3.0:1787365389.469096:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003551360 00000100:00100000:3.0:1787365389.469170:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:3.0:1787365389.469183:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+9:13759:x1874188003551360:12345-192.168.203.13@tcp:256:mount.lustre.0 20000000:01000000:3.0:1787365389.469224:0:14402:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:3.0:1787365389.469258:0:14402:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:3.0:1787365389.469263:0:14402:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:3.0:1787365389.469266:0:14402:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:3.0:1787365389.469269:0:14402:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:2.0:1787365389.477030:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bb850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+9:13759:x1874188003551360:12345-192.168.203.13@tcp:256:mount.lustre.0 Request processed in 7831us (8544us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365389.477052:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 85 00000100:00100000:1.0:1787365389.480923:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365389.481040:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003551488 00000100:00100000:0.0:1787365389.481054:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003551488 00000100:00100000:0.0:1787365389.481131:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:0.0:1787365389.481163:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+9:13759:x1874188003551488:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:0.0:1787365389.481187:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365389.481220:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27c2045800/0x872d29295eb4804b lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989893f4 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365389.481258:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27c2045800/0x872d29295eb4804b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989893f4 expref: 10 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365389.481272:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27c2045800/0x872d29295eb4804b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989893f4 expref: 10 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365389.481282:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27c2045800, rc 0) 00000100:00100000:0.0:1787365389.481360:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65ba050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+10:13759:x1874188003551488:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 200us (451us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365389.481369:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 86 00000100:00100000:1.0:1787365389.491826:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365389.492049:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003551616 00000100:00100000:2.0:1787365389.492063:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003551616 00000100:00100000:2.0:1787365389.492142:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:2.0:1787365389.492153:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+10:13759:x1874188003551616:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:2.0:1787365389.492560:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bac50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+10:13759:x1874188003551616:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 407us (748us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365389.492570:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 87 00000100:00100000:3.0:1787365389.496166:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365389.496372:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003551744 00000100:00100000:2.0:1787365389.496384:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003551744 00000100:00100000:2.0:1787365389.496451:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:2.0:1787365389.496463:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+10:13759:x1874188003551744:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787365389.497971:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65b8050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+10:13759:x1874188003551744:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 1496us (1805us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365389.497986:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 88 00000100:00100000:3.0:1787365389.507146:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365389.507583:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003551872 00000100:00100000:0.0:1787365389.507596:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003551872 00000100:00100000:0.0:1787365389.507711:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:0.0:1787365389.507722:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+10:13783:x1874188003551872:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787365389.508361:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65b8c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+10:13783:x1874188003551872:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 636us (1224us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365389.508371:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 89 00000100:00100000:1.0:1787365389.510290:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365389.510382:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003552000 00000100:00100000:2.0:1787365389.510395:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003552000 00000100:00100000:2.0:1787365389.510462:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:2.0:1787365389.510473:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+10:13783:x1874188003552000:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787365389.510989:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65b9450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+10:13783:x1874188003552000:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 514us (708us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365389.511007:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 90 00000100:00100000:3.0:1787365389.540430:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365389.540790:0:15822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003552128 00000100:00100000:2.0:1787365389.540805:0:15822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003552128 00000100:00100000:2.0:1787365389.540878:0:15822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:2.0:1787365389.540889:0:15822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:0+-99:2358:x1874188003552128:12345-192.168.203.13@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787365389.541039:0:15822:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from f02bb255-97c1-4c08-8e1d-6c853c05ec45@192.168.203.13@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:2.0:1787365389.541104:0:15822:0:(genops.c:1385:class_connect()) connect: client f02bb255-97c1-4c08-8e1d-6c853c05ec45, cookie 0x872d29295eb48052 00000004:00100000:2.0:1787365389.541145:0:15822:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000001:00000004:2.0:1787365389.541152:0:15822:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-MDT0000_UUID: mount_count is 2, last_transno is 8589934592 00000100:00080000:2.0:1787365389.610832:0:15822:0:(import.c:65:import_set_state_nolock()) ffff9f27982b8000 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787365389.610949:0:15822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf90380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f02bb255-97c1-4c08-8e1d-6c853c05ec45+6:2358:x1874188003552128:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 70058us (70542us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365389.610963:0:15822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:3.0:1787365389.613720:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365389.614735:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365389.615045:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003552256 00000100:00100000:0.0:1787365389.615059:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003552256 00000100:00100000:0.0:1787365389.615151:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003552384 00000100:00100000:0.0:1787365389.615155:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003552384 00000100:00100000:0.0:1787365389.615182:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:0.0:1787365389.615195:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+7:0:x1874188003552256:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787365389.615282:0:14410:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787365389.615392:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf91c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+7:0:x1874188003552256:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 199us (1685us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365389.615401:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:0.0:1787365389.615422:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:0.0:1787365389.615429:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+6:13759:x1874188003552384:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:0.0:1787365389.615442:0:14410:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:0.0:1787365389.615465:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf91500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+6:13759:x1874188003552384:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 37us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365389.615471:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00080000:1.0:1787365389.616783:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365389.618238:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365389.618400:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003552512 00000100:00100000:0.0:1787365389.618414:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003552512 00000100:00100000:0.0:1787365389.618490:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:0.0:1787365389.618503:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+6:13759:x1874188003552512:12345-192.168.203.13@tcp:40:mount.lustre.0 00000100:00100000:0.0:1787365389.619305:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf90e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+6:13759:x1874188003552512:12345-192.168.203.13@tcp:40:mount.lustre.0 Request processed in 799us (1073us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365389.619317:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:0.0:1787365389.623422:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365389.623473:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365389.623736:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003552640 00000100:00100000:3.0:1787365389.623750:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003552640 00000100:00100000:3.0:1787365389.623812:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003552768 00000100:00100000:3.0:1787365389.623816:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003552768 00000100:00100000:3.0:1787365389.623846:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:3.0:1787365389.623856:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279809a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1874188003552640:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787365389.623897:0:15094:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from f02bb255-97c1-4c08-8e1d-6c853c05ec45@192.168.203.13@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:3.0:1787365389.623945:0:15094:0:(genops.c:1385:class_connect()) connect: client f02bb255-97c1-4c08-8e1d-6c853c05ec45, cookie 0x872d29295eb48059 00002000:00100000:3.0:1787365389.623960:0:15094:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli f02bb255-97c1-4c08-8e1d-6c853c05ec45/ffff9f2686738000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787365389.623991:0:15094:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787365389.624797:0:15094:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787365389.624854:0:15094:0:(import.c:65:import_set_state_nolock()) ffff9f268673b000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787365389.625304:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279809a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+6:2358:x1874188003552640:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 1447us (1894us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365389.625316:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:3.0:1787365389.625474:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:3.0:1787365389.625481:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:0+-99:2358:x1874188003552768:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787365389.625512:0:15094:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from f02bb255-97c1-4c08-8e1d-6c853c05ec45@192.168.203.13@tcp t0 exp 0000000000000000 cur 506 last 0 00000020:00000080:3.0:1787365389.625545:0:15094:0:(genops.c:1385:class_connect()) connect: client f02bb255-97c1-4c08-8e1d-6c853c05ec45, cookie 0x872d29295eb48060 00002000:00100000:3.0:1787365389.625557:0:15094:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli f02bb255-97c1-4c08-8e1d-6c853c05ec45/ffff9f2784b75000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787365389.625567:0:15094:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787365389.627675:0:15094:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787365389.627761:0:15094:0:(import.c:65:import_set_state_nolock()) ffff9f278425c000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787365389.628245:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798099f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+6:2358:x1874188003552768:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 2758us (4767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365389.628258:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:0.0:1787365389.630116:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365389.631669:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003552896 00000100:00100000:2.0:1787365389.631689:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003552896 00000100:00100000:2.0:1787365389.631768:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:2.0:1787365389.631789:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+6:13759:x1874188003552896:12345-192.168.203.13@tcp:33:mount.lustre.0 00000004:00080000:0.0:1787365389.635386:0:14411:0:(mdt_identity.c:119:mdt_identity_do_upcall()) lustre-MDT0000: invoked upcall /home/green/git/lustre-release/lustre/utils/l_getidentity lustre-MDT0000 0, time 3346us 00000004:00200000:0.0:1787365389.653327:0:14411:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787365389.653572:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+6:13759:x1874188003552896:12345-192.168.203.13@tcp:33:mount.lustre.0 Request processed in 21785us (23461us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365389.653603:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1787365389.683169:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:1.0:1787365389.683220:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024519424:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787365389.683322:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365389.683513:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024519424 00000100:00100000:3.0:1787365389.683524:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024519424 00000100:00100000:3.0:1787365389.683598:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:3.0:1787365389.683610:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb40b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024519424:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787365389.683666:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365389.683724:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb40b800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024519424:12345-0@lo:13:osp-pre-0-0.0 Request processed in 116us (402us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365389.683732:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:1.0:1787365389.684179:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf93100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024519424:0@lo:13:osp-pre-0-0.0 00000100:00100000:0.0:1787365389.861346:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365389.861452:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003553024 00000100:00100000:3.0:1787365389.861465:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003553024 00000100:00100000:3.0:1787365389.861545:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:3.0:1787365389.861556:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279809bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+6:13804:x1874188003553024:12345-192.168.203.13@tcp:101:mkdir.0 00010000:00010000:3.0:1787365389.861581:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365389.861615:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44e00/0x872d29295eb48067 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898941e expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365389.861748:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb4806e lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365389.861766:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb4806e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365389.861785:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb4806e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365389.862294:0:14408:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787365389.862307:0:14408:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:3.0:1787365389.862491:0:14408:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb4806e lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365389.862530:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44e00/0x872d29295eb48067 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898941e expref: 8 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365389.862553:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb4806e lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898941e expref: 7 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365389.862563:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2789e48c00) 00010000:00010000:3.0:1787365389.862566:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787365389.862571:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45a00, rc 0) 00000100:00100000:3.0:1787365389.862845:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279809bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+7:13804:x1874188003553024:12345-192.168.203.13@tcp:101:mkdir.0 Request processed in 1279us (1513us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365389.862855:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00010000:00010000:1.0:1787365390.003001:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365391.027913:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:1.0:1787365392.056864:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365392.057361:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365392.063412:0:15822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003553152 00000100:00100000:2.0:1787365392.063435:0:15822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003553152 00000100:00100000:2.0:1787365392.063684:0:15822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:2.0:1787365392.063700:0:15822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f02bb255-97c1-4c08-8e1d-6c853c05ec45+7:13856:x1874188003553152:12345-192.168.203.13@tcp:41:lfs.0 00000004:00000024:2.0:1787365392.063771:0:15822:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 3407872 pending 0 free 2261647360 avail 2259550208 00000100:00100000:2.0:1787365392.063900:0:15822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798098a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f02bb255-97c1-4c08-8e1d-6c853c05ec45+7:13856:x1874188003553152:12345-192.168.203.13@tcp:41:lfs.0 Request processed in 205us (6558us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365392.063908:0:15822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:3.0:1787365392.067514:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365392.069414:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003553280 00000100:00100000:2.0:1787365392.069438:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003553280 00000100:00080000:1.0:1787365392.069565:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787365392.069572:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365392.073920:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:2.0:1787365392.073955:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f02bb255-97c1-4c08-8e1d-6c853c05ec45+6:13856:x1874188003553280:12345-192.168.203.13@tcp:13:lfs.0 00002000:00000024:2.0:1787365392.074014:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:2.0:1787365392.074145:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf91880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f02bb255-97c1-4c08-8e1d-6c853c05ec45+6:13856:x1874188003553280:12345-192.168.203.13@tcp:13:lfs.0 Request processed in 207us (6643us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365392.074154:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:2.0:1787365392.084672:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365392.084879:0:15096:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003553408 00000100:00100000:3.0:1787365392.084892:0:15096:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003553408 00000100:00100000:3.0:1787365392.085046:0:15096:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1787365392.085059:0:15096:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f02bb255-97c1-4c08-8e1d-6c853c05ec45+6:13856:x1874188003553408:12345-192.168.203.13@tcp:13:lfs.0 00002000:00000024:3.0:1787365392.085111:0:15096:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 44236800 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365392.085252:0:15096:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808f800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:f02bb255-97c1-4c08-8e1d-6c853c05ec45+6:13856:x1874188003553408:12345-192.168.203.13@tcp:13:lfs.0 Request processed in 196us (597us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365392.085261:0:15096:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00080000:1.0:1787365392.085327:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:0.0:1787365392.283170:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365392.283307:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003553536 00000100:00100000:3.0:1787365392.283322:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003553536 00000100:00100000:3.0:1787365392.283399:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:3.0:1787365392.283440:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+10:13887:x1874188003553536:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787365392.283464:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365392.283489:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2788f44e00/0x872d29295eb48075 lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989425 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365392.283528:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2788f44e00/0x872d29295eb48075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989425 expref: 11 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365392.283541:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2788f44e00/0x872d29295eb48075 lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x0:0x0].0x0 rrc: 11 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989425 expref: 11 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365392.283552:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44e00, rc 0) 00000100:00100000:3.0:1787365392.283663:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65ba850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+11:13887:x1874188003553536:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 225us (508us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365392.283671:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 91 00000100:00100000:2.0:1787365392.291327:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365392.295083:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003553664 00000100:00100000:3.0:1787365392.295107:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003553664 00000100:00100000:3.0:1787365392.295221:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 92 00000100:00100000:3.0:1787365392.295235:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+11:13887:x1874188003553664:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787365392.295701:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65bbc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+11:13887:x1874188003553664:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 466us (4387us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365392.295712:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 92 00000100:00100000:0.0:1787365392.298680:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365392.299025:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003553792 00000100:00100000:2.0:1787365392.299036:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003553792 00000100:00100000:2.0:1787365392.299153:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:2.0:1787365392.299167:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+11:13887:x1874188003553792:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:2.0:1787365392.299492:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65b9050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+11:13887:x1874188003553792:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 327us (866us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365392.299501:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 93 00000100:00100000:1.0:1787365392.317354:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365392.326001:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003553920 00000100:00100000:0.0:1787365392.326021:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003553920 00000100:00100000:0.0:1787365392.326117:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:0.0:1787365392.326130:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+11:13893:x1874188003553920:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:0.0:1787365392.326521:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65ba450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+11:13893:x1874188003553920:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 392us (9179us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365392.326531:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 94 00000100:00100000:0.0:1787365392.391493:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365392.397250:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003554048 00000100:00100000:2.0:1787365392.397272:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003554048 00000100:00100000:2.0:1787365392.397376:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:2.0:1787365392.397388:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+11:13893:x1874188003554048:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:2.0:1787365392.397800:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65b8450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+11:13893:x1874188003554048:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 413us (6319us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365392.397809:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 95 00000100:00100000:2.0:1787365392.413037:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365392.413480:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003554176 00000100:00100000:3.0:1787365392.413493:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003554176 00000100:00100000:3.0:1787365392.413605:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00100000:3.0:1787365392.413618:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+11:13887:x1874188003554176:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787365392.413666:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365392.413710:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2788f44600/0x872d29295eb4807c lrc: 2/0,0 mode: --/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898944f expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365392.413749:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2788f44600/0x872d29295eb4807c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898944f expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365392.413763:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2788f44600/0x872d29295eb4807c lrc: 3/0,0 mode: CR/CR res: [0x65727473756c:0x2:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898944f expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365392.413775:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44600, rc 0) 00000100:00100000:3.0:1787365392.413907:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65b9850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+12:13887:x1874188003554176:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 291us (885us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365392.416321:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 96 00000100:00100000:1.0:1787365392.429548:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365392.429667:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003554304 00000100:00100000:0.0:1787365392.429680:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003554304 00000100:00100000:0.0:1787365392.429748:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:0.0:1787365392.429758:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+12:13887:x1874188003554304:12345-192.168.203.13@tcp:256:mount.lustre.0 20000000:01000000:0.0:1787365392.429794:0:14401:0:(mgs_nids.c:914:mgs_get_ir_logs()) Reading IR log lustre-cliir bufsize 1048576. 20000000:01000000:0.0:1787365392.429900:0:14401:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4052/1/256/255. 20000000:01000000:0.0:1787365392.429906:0:14401:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 4008/1/256/255. 20000000:01000000:0.0:1787365392.429970:0:14401:0:(mgs_nids.c:307:mgs_nidtbl_read()) fsname lustre, entry size 44, pages 3964/1/256/255. 20000000:01000000:0.0:1787365392.429973:0:14401:0:(mgs_nids.c:318:mgs_nidtbl_read()) Read IR logs lustre return with 132, version 8 00000100:00100000:3.0:1787365392.434321:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787924450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+12:13887:x1874188003554304:12345-192.168.203.13@tcp:256:mount.lustre.0 Request processed in 4548us (4773us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365392.434357:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 97 00000100:00100000:1.0:1787365392.440134:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365392.440270:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003554432 00000100:00100000:3.0:1787365392.440283:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003554432 00000100:00100000:3.0:1787365392.440562:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:3.0:1787365392.440575:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787926c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+12:13887:x1874188003554432:12345-192.168.203.13@tcp:101:mount.lustre.0 00010000:00010000:3.0:1787365392.440598:0:14403:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365392.440622:0:14403:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2788f45200/0x872d29295eb48083 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989456 expref: -99 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365392.440680:0:14403:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2788f45200/0x872d29295eb48083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989456 expref: 13 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365392.440693:0:14403:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2788f45200/0x872d29295eb48083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989456 expref: 13 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365392.440726:0:14403:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45200, rc 0) 00000100:00100000:3.0:1787365392.440804:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787926c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+13:13887:x1874188003554432:12345-192.168.203.13@tcp:101:mount.lustre.0 Request processed in 230us (759us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365392.440813:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 98 00000100:00100000:1.0:1787365392.443321:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365392.443533:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003554560 00000100:00100000:3.0:1787365392.443546:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003554560 00000100:00100000:3.0:1787365392.443665:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:3.0:1787365392.443675:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+13:13887:x1874188003554560:12345-192.168.203.13@tcp:501:mount.lustre.0 00000100:00100000:3.0:1787365392.444199:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787927450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+13:13887:x1874188003554560:12345-192.168.203.13@tcp:501:mount.lustre.0 Request processed in 515us (880us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365392.444209:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 99 00000100:00100000:1.0:1787365392.446971:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365392.447138:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003554688 00000100:00100000:3.0:1787365392.447151:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003554688 00000100:00100000:3.0:1787365392.447265:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:3.0:1787365392.447278:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+13:13887:x1874188003554688:12345-192.168.203.13@tcp:503:mount.lustre.0 00000100:00100000:3.0:1787365392.447587:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787926050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+13:13887:x1874188003554688:12345-192.168.203.13@tcp:503:mount.lustre.0 Request processed in 310us (686us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365392.447596:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 100 00000100:00100000:1.0:1787365392.451772:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365392.451955:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003554816 00000100:00100000:3.0:1787365392.451967:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003554816 00000100:00100000:3.0:1787365392.452145:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:3.0:1787365392.452157:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+13:13900:x1874188003554816:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787365392.452527:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787925050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+13:13900:x1874188003554816:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 371us (767us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365392.452545:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 101 00000100:00100000:1.0:1787365392.467450:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365392.467600:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003554944 00000100:00100000:3.0:1787365392.467614:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003554944 00000100:00100000:3.0:1787365392.467740:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 102 00000100:00100000:3.0:1787365392.467752:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+13:13900:x1874188003554944:12345-192.168.203.13@tcp:502:llog_process_th.0 00000100:00100000:3.0:1787365392.468216:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787926850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+13:13900:x1874188003554944:12345-192.168.203.13@tcp:502:llog_process_th.0 Request processed in 465us (781us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365392.468227:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 102 00000100:00100000:0.0:1787365392.483256:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365392.484025:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003555072 00000100:00100000:2.0:1787365392.484139:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003555072 00000100:00100000:2.0:1787365392.484219:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:2.0:1787365392.484229:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:0+-99:2358:x1874188003555072:12345-192.168.203.13@tcp:38:mount.lustre.0 00010000:00080000:2.0:1787365392.484269:0:14409:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-MDT0000: connection from 2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9@192.168.203.13@tcp t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:2.0:1787365392.484318:0:14409:0:(genops.c:1385:class_connect()) connect: client 2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9, cookie 0x872d29295eb4808a 00000004:00100000:2.0:1787365392.484812:0:14409:0:(mdt_handler.c:7293:mdt_connect_internal()) lustre-MDT0000: cli supports cksum type f7, return f7 00000100:00080000:2.0:1787365392.485042:0:14409:0:(import.c:65:import_set_state_nolock()) ffff9f27bb900800 : changing import state from RECOVER to FULL 00000100:00100000:2.0:1787365392.486267:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798098380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+6:2358:x1874188003555072:12345-192.168.203.13@tcp:38:mount.lustre.0 Request processed in 2028us (3016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365392.486283:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:1.0:1787365392.491304:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365392.491888:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365392.492207:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003555200 00000100:00100000:3.0:1787365392.492220:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003555200 00000100:00100000:3.0:1787365392.492306:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003555328 00000100:00100000:3.0:1787365392.492310:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003555328 00000100:00100000:3.0:1787365392.492333:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1787365392.492345:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb40a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+7:0:x1874188003555200:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787365392.492389:0:14410:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00100000:3.0:1787365392.492477:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb40a300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+7:0:x1874188003555200:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 134us (1187us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365392.492486:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1787365392.492505:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1787365392.492512:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+6:13887:x1874188003555328:12345-192.168.203.13@tcp:41:mount.lustre.0 00000004:00000024:3.0:1787365392.492524:0:14410:0:(mdt_handler.c:540:mdt_statfs()) blocks cached 0 granted 6815744 pending 0 free 2261647360 avail 2259550208 00000100:00080000:1.0:1787365392.492623:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365392.492708:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798098e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+6:13887:x1874188003555328:12345-192.168.203.13@tcp:41:mount.lustre.0 Request processed in 194us (829us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365392.492716:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000040:00080000:1.0:1787365392.500798:0:14442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787365392.503282:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365392.504410:0:15822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003555456 00000100:00100000:2.0:1787365392.504427:0:15822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003555456 00000100:00100000:2.0:1787365392.504554:0:15822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:2.0:1787365392.504565:0:15822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb40bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+6:13887:x1874188003555456:12345-192.168.203.13@tcp:40:mount.lustre.0 00000100:00100000:2.0:1787365392.504701:0:15822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb40bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+6:13887:x1874188003555456:12345-192.168.203.13@tcp:40:mount.lustre.0 Request processed in 138us (1433us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365392.504709:0:15822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:1.0:1787365392.507904:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365392.507958:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365392.508019:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365392.508107:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003555584 00000100:00100000:3.0:1787365392.508120:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003555584 00000100:00100000:3.0:1787365392.508170:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003555712 00000100:00100000:3.0:1787365392.508173:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003555712 00000100:00100000:3.0:1787365392.508214:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:3.0:1787365392.508222:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1874188003555584:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787365392.508263:0:15091:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0000: connection from 2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9@192.168.203.13@tcp t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:3.0:1787365392.508304:0:15091:0:(genops.c:1385:class_connect()) connect: client 2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9, cookie 0x872d29295eb48091 00002000:00100000:3.0:1787365392.508320:0:15091:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0000: cli 2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9/ffff9f278425a000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787365392.508332:0:15091:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0000: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787365392.508486:0:15091:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0000: get connection from MDS 0 00000100:00080000:3.0:1787365392.508524:0:15091:0:(import.c:65:import_set_state_nolock()) ffff9f2784258000 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787365392.508606:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb409f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+6:2358:x1874188003555584:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 382us (645us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365392.508614:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:3.0:1787365392.508674:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1787365392.508679:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:0+-99:2358:x1874188003555712:12345-192.168.203.13@tcp:8:mount.lustre.0 00010000:00080000:3.0:1787365392.508696:0:15091:0:(ldlm_lib.c:1444:target_handle_connect()) lustre-OST0001: connection from 2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9@192.168.203.13@tcp t0 exp 0000000000000000 cur 509 last 0 00000020:00000080:3.0:1787365392.508714:0:15091:0:(genops.c:1385:class_connect()) connect: client 2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9, cookie 0x872d29295eb48098 00002000:00100000:3.0:1787365392.508719:0:15091:0:(ofd_obd.c:121:ofd_parse_connect_data()) lustre-OST0001: cli 2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9/ffff9f2784259000 ocd_connect_flags: 0xa0467af2e3640038 ocd_version: 211392e ocd_grant: 134217728 ocd_index: 0 ocd_group 0 00002000:00100000:3.0:1787365392.508726:0:15091:0:(ofd_obd.c:219:ofd_parse_connect_data()) lustre-OST0001: cli supports cksum type f7, return f7 00002000:00080000:3.0:1787365392.508788:0:15091:0:(ofd_obd.c:385:ofd_obd_connect()) lustre-OST0001: get connection from MDS 0 00000100:00080000:3.0:1787365392.508804:0:15091:0:(import.c:65:import_set_state_nolock()) ffff9f278425a800 : changing import state from RECOVER to FULL 00000100:00100000:3.0:1787365392.508828:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb409c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+6:2358:x1874188003555712:12345-192.168.203.13@tcp:8:mount.lustre.0 Request processed in 147us (809us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365392.508836:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:0.0:1787365392.509404:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003555840 00000100:00100000:0.0:1787365392.509415:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003555840 00000100:00100000:0.0:1787365392.509479:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:0.0:1787365392.509489:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+6:13887:x1874188003555840:12345-192.168.203.13@tcp:33:mount.lustre.0 00000004:00200000:0.0:1787365392.509777:0:14412:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000100:00100000:0.0:1787365392.509928:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+6:13887:x1874188003555840:12345-192.168.203.13@tcp:33:mount.lustre.0 Request processed in 440us (2037us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365392.509937:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:2.0:1787365392.759195:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365392.759397:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003555968 00000100:00100000:1.0:1787365392.759410:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003555968 00000100:00100000:1.0:1787365392.759510:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:1.0:1787365392.759539:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+6:13921:x1874188003555968:12345-192.168.203.13@tcp:101:mkdir.0 00010000:00010000:1.0:1787365392.759566:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365392.759593:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb4809f lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989480 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365392.759695:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb480a6 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365392.759714:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb480a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365392.759728:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb480a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787365392.759986:0:14410:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:1.0:1787365392.759991:0:14410:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 3 stripe count 1 MDT count 1 00000004:00010000:1.0:1787365392.760076:0:14410:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb480a6 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365392.760105:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798115e00/0x872d29295eb4809f lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989480 expref: 8 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365392.760122:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb480a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989480 expref: 7 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365392.760132:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2789e48c00) 00010000:00010000:1.0:1787365392.760135:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:1.0:1787365392.760138:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798114400, rc 0) 00000100:00100000:1.0:1787365392.760400:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808fb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+7:13921:x1874188003555968:12345-192.168.203.13@tcp:101:mkdir.0 Request processed in 861us (1220us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365392.760419:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00010000:00010000:1.0:1787365393.075051:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00100000:1.0:1787365393.841905:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of 2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9 00000001:00100000:1.0:1787365393.841927:0:6707:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0000: committing for initial connect of f02bb255-97c1-4c08-8e1d-6c853c05ec45 00010000:00010000:1.0:1787365394.100009:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365394.292750:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2798099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3310:1874188024519552:0@lo:400:kworker.0 00000100:00100000:2.0:1787365394.292860:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365394.295818:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024519680:0@lo:400:kworker.0 00000100:00100000:0.0:1787365394.296043:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365394.296073:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874188024519936:0@lo:400:kworker.0 00000100:00100000:3.0:1787365394.296111:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365394.296131:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874188024520192:0@lo:400:kworker.0 00000100:00100000:3.0:1787365394.296154:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:3.0:1787365394.296160:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024519808:0@lo:400:kworker.0 00000100:00100000:0.0:1787365394.296160:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365394.296191:0:3311:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [0->1] 00000100:00100000:3.0:1787365394.296193:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365394.296197:0:3311:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024520064:0@lo:400:kworker.0 00000100:00100000:0.0:1787365394.296223:0:3311:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365394.296236:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024519680 00000100:00100000:3.0:1787365394.296245:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024519680 00000100:00100000:0.0:1787365394.296250:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024519936 00000100:00100000:0.0:1787365394.296253:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024519936 00000100:00100000:0.0:1787365394.296304:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024520192 00000100:00100000:0.0:1787365394.296307:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024520192 00000100:00100000:3.0:1787365394.296468:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024519808 00000100:00100000:3.0:1787365394.296472:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024519808 00000100:00100000:1.0:1787365394.299035:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024520064 00000100:00100000:1.0:1787365394.299055:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024520064 00000100:00100000:0.0:1787365394.299427:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787365394.299441:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874188024519936:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365394.299739:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf90700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874188024519936:12345-0@lo:400:kworker.0 Request processed in 300us (3626us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365394.299747:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 16 00000100:00100000:0.0:1787365394.299767:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787365394.299774:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874188024520192:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365394.299883:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c5180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000-lwp-OST0001_UUID+5:3311:x1874188024520192:12345-0@lo:400:kworker.0 Request processed in 109us (3720us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365394.299970:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 17 00000100:00100000:0.0:1787365394.300032:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0001_UUID:3311:1874188024520192:0@lo:400:kworker.0 00000100:00100000:0.0:1787365394.300161:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024520320:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787365394.300214:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365394.300275:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024520320 00000100:00100000:0.0:1787365394.300280:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024520320 00000100:00100000:0.0:1787365394.300317:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787365394.300325:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874188024520320:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:0.0:1787365394.300363:0:15095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787365394.300403:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c6d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+6:3312:x1874188024520320:12345-0@lo:13:osp-pre-1-0.0 Request processed in 79us (189us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365394.300410:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 8 00000100:00100000:0.0:1787365394.300431:0:3312:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934593 gen 2 00000100:00100000:0.0:1787365394.300450:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024520320:0@lo:13:osp-pre-1-0.0 00000100:00080000:2.0:1787365394.301740:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787365394.301751:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:2.0:1787365394.301755:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787365394.301797:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787365394.301815:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024519680:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365394.302034:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3311:x1874188024519680:12345-0@lo:400:kworker.0 Request processed in 227us (5991us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365394.302042:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 3 00000100:00100000:2.0:1787365394.302424:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c6300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-mdtlov_UUID:3311:1874188024519680:0@lo:400:kworker.0 00000100:00100000:2.0:1787365394.303809:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024519552 00000100:00100000:2.0:1787365394.303823:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024519552 00000100:00100000:2.0:1787365394.303881:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 103 00000100:00100000:2.0:1787365394.303892:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:3310:x1874188024519552:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365394.308747:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787927850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:3310:x1874188024519552:12345-0@lo:400:kworker.0 Request processed in 4845us (15876us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365394.308765:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 103 00000100:00100000:1.0:1787365394.311325:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 18 00000100:00100000:1.0:1787365394.311345:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024520064:12345-0@lo:400:kworker.0 00000100:00100000:1.0:1787365394.311467:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c7800 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3311:x1874188024520064:12345-0@lo:400:kworker.0 Request processed in 129us (15242us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365394.311476:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 18 00000100:00100000:3.0:1787365394.312410:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787365394.312422:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024519808:12345-0@lo:400:kworker.0 00000100:00100000:3.0:1787365394.312482:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf92680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024519808:12345-0@lo:400:kworker.0 Request processed in 64us (16289us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365394.312490:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:3.0:1787365394.312573:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2798099c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3310:1874188024519552:0@lo:400:kworker.0 00000100:00100000:2.0:1787365394.313388:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874188024519936:0@lo:400:kworker.0 00000100:00100000:2.0:1787365394.313425:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c7480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024519808:0@lo:400:kworker.0 00000100:00100000:3.0:1787365394.315602:0:3311:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c4380 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_01:lustre-MDT0000-lwp-OST0000_UUID:3311:1874188024520064:0@lo:400:kworker.0 00000001:00100000:1.0:1787365394.381788:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of 2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9 00000001:00100000:1.0:1787365394.381808:0:7624:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-OST0001: committing for initial connect of f02bb255-97c1-4c08-8e1d-6c853c05ec45 00000100:00100000:2.0:1787365394.803222:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27baf92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024520448:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787365394.803316:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365394.803672:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024520448 00000100:00100000:0.0:1787365394.803683:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024520448 00000100:00100000:0.0:1787365394.803751:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787365394.803762:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024520448:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:0.0:1787365394.803806:0:15095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:0.0:1787365394.803873:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024520448:12345-0@lo:13:osp-pre-0-0.0 Request processed in 113us (557us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365394.803882:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:2.0:1787365394.804059:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27baf92d80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024520448:0@lo:13:osp-pre-0-0.0 00000001:00100000:3.0:1787365394.879500:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of 2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9 00000001:00100000:3.0:1787365394.879521:0:5855:0:(tgt_lastrcvd.c:563:tgt_cb_new_client()) lustre-MDT0000: committing for initial connect of f02bb255-97c1-4c08-8e1d-6c853c05ec45 00010000:00010000:1.0:1787365395.123072:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:1.0:1787365396.150133:0:16373:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: Using TIMEOUT=20 00010000:00010000:2.0:1787365396.151612:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365397.172203:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365397.895749:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365397.895806:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365397.896116:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003556096 00000100:00100000:0.0:1787365397.896128:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003556096 00000100:00100000:0.0:1787365397.896207:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 104 00000100:00100000:0.0:1787365397.896243:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+13:2362:x1874188003556096:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365397.896334:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787924850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+13:2362:x1874188003556096:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 94us (599us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365397.896343:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 104 00000100:00100000:3.0:1787365397.896820:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365397.896865:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365397.897516:0:15822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003556608 00000100:00100000:0.0:1787365397.897535:0:15822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003556608 00000100:00100000:0.0:1787365397.897604:0:15822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:0.0:1787365397.897614:0:15822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+6:2362:x1874188003556608:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365397.897723:0:15822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf93100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+6:2362:x1874188003556608:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 110us (908us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365397.897731:0:15822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00080000:2.0:1787365397.899622:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365397.911257:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365397.911304:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365397.911791:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003556224 00000100:00100000:0.0:1787365397.911803:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003556224 00000100:00100000:0.0:1787365397.911877:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:0.0:1787365397.911887:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+6:2362:x1874188003556224:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365397.911981:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+6:2362:x1874188003556224:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 94us (738us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365397.911989:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00080000:0.0:1787365397.914764:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365397.927353:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003556352 00000100:00100000:1.0:1787365397.927375:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003556352 00000100:00080000:1.0:1787365397.927452:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:1.0:1787365397.927531:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003556864 00000100:00100000:1.0:1787365397.927536:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003556864 00000100:00080000:1.0:1787365397.927551:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:1.0:1787365397.927577:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:1.0:1787365397.927590:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+5:2362:x1874188003556352:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365397.927710:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf92d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+5:2362:x1874188003556352:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 122us (31902us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365397.927718:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:1.0:1787365397.927888:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1787365397.927896:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+5:2362:x1874188003556864:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:1.0:1787365397.927926:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+5:2362:x1874188003556864:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 32us (31061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365397.927933:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:3.0:1787365397.929575:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003556480 00000100:00100000:3.0:1787365397.929590:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003556480 00000100:00100000:3.0:1787365397.929668:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1787365397.929679:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+5:2362:x1874188003556480:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365397.929765:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be5880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+5:2362:x1874188003556480:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 89us (18460us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365397.929773:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1787365397.929867:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365397.929907:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003556736 00000100:00100000:3.0:1787365397.929912:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003556736 00000100:00100000:3.0:1787365397.929933:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:3.0:1787365397.929940:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+5:2362:x1874188003556736:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365397.929966:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be4380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+5:2362:x1874188003556736:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (99us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365397.929973:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00080000:1.0:1787365397.938064:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787365397.938077:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00010000:00010000:1.0:1787365398.213205:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:3.0:1787365399.229307:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365399.414191:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3310:1874188024520576:0@lo:400:kworker.0 00000100:00100000:0.0:1787365399.414296:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365399.414376:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024521088:0@lo:400:kworker.0 00000100:00100000:0.0:1787365399.414408:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365399.414441:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [1->0] 00000100:00100000:0.0:1787365399.414447:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024520704:0@lo:400:kworker.0 00000100:00100000:0.0:1787365399.414497:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365399.414518:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874188024521216:0@lo:400:kworker.0 00000100:00100000:0.0:1787365399.414538:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365399.414574:0:15822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024521088 00000100:00100000:0.0:1787365399.414582:0:15822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024521088 00000100:00100000:0.0:1787365399.414671:0:15822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024521216 00000100:00100000:0.0:1787365399.414674:0:15822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024521216 00000100:00100000:0.0:1787365399.414699:0:15822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787365399.414708:0:15822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024521088:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365399.414770:0:15822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c5500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0000_UUID+5:3310:x1874188024521088:12345-0@lo:400:kworker.0 Request processed in 62us (360us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365399.414777:0:15822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 21 00000100:00100000:0.0:1787365399.414795:0:15822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787365399.414801:0:15822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874188024521216:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365399.414825:0:15822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c5880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874188024521216:12345-0@lo:400:kworker.0 Request processed in 24us (286us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365399.414830:0:15822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 22 00000100:00100000:0.0:1787365399.414850:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024520704 00000100:00100000:0.0:1787365399.414853:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024520704 00000100:00100000:0.0:1787365399.414879:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787365399.414885:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024520704:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365399.414913:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c4e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024520704:12345-0@lo:400:kworker.0 Request processed in 29us (416us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365399.414918:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 9 00000100:00100000:0.0:1787365399.414960:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024520704:0@lo:400:kworker.0 00000100:00100000:0.0:1787365399.414969:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874188024521216:0@lo:400:kworker.0 00000100:00100000:0.0:1787365399.414988:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0000_UUID:3310:1874188024521088:0@lo:400:kworker.0 00000100:00100000:2.0:1787365399.416953:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874188024520960:0@lo:400:kworker.0 00000100:00100000:2.0:1787365399.417042:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365399.417090:0:3313:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [2->3] 00000100:00100000:2.0:1787365399.417097:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024520832:0@lo:400:kworker.0 00000100:00100000:2.0:1787365399.417136:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365399.417185:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024520576 00000100:00100000:2.0:1787365399.417194:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024520576 00000100:00100000:2.0:1787365399.417249:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787365399.417259:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:3310:x1874188024520576:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365399.417326:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787927050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:3310:x1874188024520576:12345-0@lo:400:kworker.0 Request processed in 68us (3030us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365399.417334:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 105 00000100:00100000:2.0:1787365399.417373:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024520960 00000100:00100000:2.0:1787365399.417377:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024520960 00000100:00100000:2.0:1787365399.417406:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787365399.417414:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874188024520960:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365399.417453:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808d180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3313:x1874188024520960:12345-0@lo:400:kworker.0 Request processed in 40us (412us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365399.417460:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 23 00000100:00100000:2.0:1787365399.417480:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024520832 00000100:00100000:2.0:1787365399.417483:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024520832 00000100:00100000:2.0:1787365399.417518:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787365399.417526:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024520832:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365399.417558:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024520832:12345-0@lo:400:kworker.0 Request processed in 34us (422us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365399.417565:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:2.0:1787365399.417611:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c7b80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3310:1874188024520576:0@lo:400:kworker.0 00000100:00100000:2.0:1787365399.417678:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c4a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024520832:0@lo:400:kworker.0 00000100:00100000:2.0:1787365399.417688:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c4700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-lwp-MDT0000_UUID:3313:1874188024520960:0@lo:400:kworker.0 00000100:00100000:1.0:1787365399.418332:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024521344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365399.418388:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00080000:1.0:1787365399.418428:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:1.0:1787365399.418433:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:1.0:1787365399.418437:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365399.418459:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024521344 00000100:00100000:1.0:1787365399.418464:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024521344 00000100:00100000:1.0:1787365399.418500:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787365399.418507:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024521344:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787365399.418545:0:15095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365399.418592:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb408e00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024521344:12345-0@lo:13:osp-pre-1-0.0 Request processed in 85us (203us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365399.418600:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 10 00000100:00100000:1.0:1787365399.418668:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb408a80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024521344:0@lo:13:osp-pre-1-0.0 00000100:00100000:1.0:1787365399.928071:0:3313:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024521472:0@lo:13:osp-pre-0-0.0 00000100:00100000:1.0:1787365399.928182:0:3313:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365399.928437:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024521472 00000100:00100000:3.0:1787365399.928447:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024521472 00000100:00100000:3.0:1787365399.928516:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 11 00000100:00100000:3.0:1787365399.928528:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024521472:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787365399.928578:0:15095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365399.928666:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb408a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3313:x1874188024521472:12345-0@lo:13:osp-pre-0-0.0 Request processed in 139us (482us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365399.928674:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 11 00000100:00100000:1.0:1787365399.928879:0:3313:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6be7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_03:lustre-MDT0000-mdtlov_UUID:3313:1874188024521472:0@lo:13:osp-pre-0-0.0 00010000:00010000:1.0:1787365400.251181:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000020:00000080:2.0:1787365401.038901:0:16522:0:(class_obd.c:336:class_handle_ioctl()) obdclass: cmd=400866bb len=0 uarg=00007ffef684ccd0 20000000:00000080:2.0:1787365401.038923:0:16522:0:(mgs_handler.c:1167:mgs_iocontrol()) MGS: cmd=400866bb len=576 karg=ffff9f27b77f3800 uarg=0000000000000000 20000000:01000000:2.0:1787365401.038971:0:16522:0:(mgs_llog.c:6192:mgs_set_param2()) set_param2 fs='' device='general' param='lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787365401.038978:0:16522:0:(mgs_llog.c:4647:mgs_write_log_param2()) next param 'lod.*.mdt_hash=crush' 20000000:01000000:2.0:1787365401.038983:0:16522:0:(mgs_llog.c:1379:mgs_modify_param()) modify params/general/lod.*.mdt_hash=crush del=0 00000040:00080000:2.0:1787365401.049774:0:16523:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 5 count 10 20000000:00000400:3.0:1787365401.050057:0:16522:0:(mgs_llog.c:1450:mgs_modify_param()) MGS: modify general/lod.*.mdt_hash=crush (mode = 0) failed: rc = -17 10000000:01000000:3.0:1787365401.060784:0:16522:0:(mgc_request.c:68:mgc_name2resid()) log params to resid 0x736d61726170/0x3 (params) 00010000:00010000:2.0:1787365401.061034:0:16522:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: MGS lock: ffff9f27a12cd200/0x872d29295eb480ad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365401.061059:0:16522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f27b6e23000/0x872d29295eb47da4 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47d9d expref: 18 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365401.061068:0:16522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f27b6e23c00/0x872d29295eb47df1 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47dea expref: 18 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365401.061076:0:16522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f2798114600/0x872d29295eb47f2c lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb47f25 expref: 18 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365401.061088:0:16522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f27c2045800/0x872d29295eb4804b lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989893f4 expref: 12 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365401.061095:0:16522:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: MGS lock: ffff9f2788f45200/0x872d29295eb48083 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989456 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365401.061103:0:16522:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: MGS lock: ffff9f27a12cd200/0x872d29295eb480ad lrc: 8/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50210000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365401.061172:0:16522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f2788f45200/0x872d29295eb48083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989456 expref: 12 pid: 14403 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365401.061193:0:16522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f2788f45200/0x872d29295eb48083 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989456 expref: 12 pid: 14403 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365401.061226:0:16522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279808f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16522:1874188024521600:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365401.061361:0:16522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f27c2045800/0x872d29295eb4804b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989893f4 expref: 12 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365401.061370:0:16522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f27c2045800/0x872d29295eb4804b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989893f4 expref: 12 pid: 14401 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365401.061379:0:16522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279808ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16522:1874188024521728:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365401.061414:0:16522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f2798114600/0x872d29295eb47f2c lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb47f25 expref: 18 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365401.061423:0:16522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f2798114600/0x872d29295eb47f2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb47f25 expref: 18 pid: 14402 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365401.061432:0:16522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279808d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16522:1874188024521856:0@lo:104: 00000100:00100000:2.0:1787365401.061481:0:16522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787365401.061529:0:16522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f27b6e23c00/0x872d29295eb47df1 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb47dea expref: 18 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365401.061537:0:16522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f27b6e23c00/0x872d29295eb47df1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb47dea expref: 18 pid: 14401 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365401.061544:0:16522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279808f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16522:1874188024521984:0@lo:104: 00000100:00100000:2.0:1787365401.061564:0:16522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00010000:00010000:2.0:1787365401.061588:0:16522:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: MGS lock: ffff9f27b6e23000/0x872d29295eb47da4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x50000000000020 nid: 0@lo remote: 0x872d29295eb47d9d expref: 18 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365401.061596:0:16522:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: MGS lock: ffff9f27b6e23000/0x872d29295eb47da4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x70000400000020 nid: 0@lo remote: 0x872d29295eb47d9d expref: 18 pid: 14401 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365401.061612:0:16522:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279808c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16522:1874188024522112:0@lo:104: 00000100:00100000:2.0:1787365401.061665:0:16522:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365401.061676:0:16522:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878bec00 going to sleep for 11 seconds 00000100:00100000:0.0:1787365401.062139:0:14391:0:(service.c:155:ptlrpc_grow_req_bufs()) ldlm_cbd: allocate 1 new 8192-byte reqbufs (0/2 left), rc = 0 00000100:00100000:0.0:1787365401.062158:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024521856 00000100:00100000:0.0:1787365401.062165:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024521856 00000100:00100000:0.0:1787365401.062211:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024521984 00000100:00100000:0.0:1787365401.062214:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024521984 00000100:00100000:0.0:1787365401.062224:0:14391:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024522112 00000100:00100000:0.0:1787365401.062227:0:14391:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024522112 00000100:00100000:0.0:1787365401.062241:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787365401.062251:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+5:16522:x1874188024521856:12345-0@lo:104: 00010000:00010000:0.0:1787365401.062266:0:14391:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd800/0x872d29295eb47f25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb47f2c expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.062335:0:14391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to priority blp list, 1 blwis in pool 00000100:00100000:0.0:1787365401.062342:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808c380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+5:16522:x1874188024521856:12345-0@lo:104: Request processed in 92us (862us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365401.062350:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787365401.062372:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787365401.062378:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+4:16522:x1874188024521984:12345-0@lo:104: 00010000:00010000:0.0:1787365401.062386:0:14391:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f2798114000/0x872d29295eb47dea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb47df1 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.062422:0:14391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/2 locks to priority blp list, 2 blwis in pool 00000100:00100000:0.0:1787365401.062428:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808e300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+4:16522:x1874188024521984:12345-0@lo:104: Request processed in 51us (863us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365401.062433:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787365401.062446:0:14391:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787365401.062453:0:14391:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb7ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+3:16522:x1874188024522112:12345-0@lo:104: 00010000:00010000:0.0:1787365401.062470:0:14391:0:(ldlm_lockd.c:2506:ldlm_callback_handler()) ### blocking ast ns: MGC192.168.203.113@tcp lock: ffff9f2788f44400/0x872d29295eb47d9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb47da4 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.062500:0:14391:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/3 locks to priority blp list, 3 blwis in pool 00000100:00100000:0.0:1787365401.062504:0:14391:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb7ecc50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cb00_000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+3:16522:x1874188024522112:12345-0@lo:104: Request processed in 53us (840us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365401.062511:0:14391:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00010000:00010000:0.0:1787365401.062551:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 2 total in blp. (2 blwis in pool) 00010000:00010000:0.0:1787365401.062557:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd800/0x872d29295eb47f25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb47f2c expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.062565:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cd800 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:0.0:1787365401.062570:0:14396:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd800/0x872d29295eb47f25 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb47f2c expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.062579:0:14396:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd800/0x872d29295eb47f25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb47f2c expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365401.062587:0:14396:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd800/0x872d29295eb47f25 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb47f2c expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365401.062593:0:14396:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787365401.062657:0:14396:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd800/0x872d29295eb47f25 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb47f2c expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.062665:0:14396:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787365401.062689:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd800/0x872d29295eb47f25 lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb47f2c expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.062695:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f27a12cd800/0x872d29295eb47f25 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb47f2c expref: -99 pid: 15808 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.062718:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 1 total in blp. (1 blwis in pool) 00010000:00010000:0.0:1787365401.062721:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f2798114000/0x872d29295eb47dea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb47df1 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.062727:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114000 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:0.0:1787365401.062730:0:14396:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f2798114000/0x872d29295eb47dea lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb47df1 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.062753:0:14396:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f2798114000/0x872d29295eb47dea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb47df1 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365401.062760:0:14396:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f2798114000/0x872d29295eb47dea lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb47df1 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365401.062766:0:14396:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787365401.062781:0:14396:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f2798114000/0x872d29295eb47dea lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb47df1 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.062787:0:14396:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787365401.062793:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f2798114000/0x872d29295eb47dea lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb47df1 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.062800:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f2798114000/0x872d29295eb47dea lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb47df1 expref: -99 pid: 15090 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.062809:0:14396:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365401.062812:0:14396:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGC192.168.203.113@tcp lock: ffff9f2788f44400/0x872d29295eb47d9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400000000000 nid: local remote: 0x872d29295eb47da4 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.062829:0:14396:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44400 already unused, calling callback (ffffffffc1c8fc20) 10000000:00010000:0.0:1787365401.062832:0:14396:0:(mgc_request.c:922:mgc_blocking_ast()) ### MGC blocking CB ns: MGC192.168.203.113@tcp lock: ffff9f2788f44400/0x872d29295eb47d9d lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1400400000000 nid: local remote: 0x872d29295eb47da4 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.062839:0:14396:0:(ldlm_request.c:1391:ldlm_cli_cancel_local()) ### client-side cancel ns: MGC192.168.203.113@tcp lock: ffff9f2788f44400/0x872d29295eb47d9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1408400000000 nid: local remote: 0x872d29295eb47da4 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:00010000:0.0:1787365401.062844:0:14396:0:(mgc_request.c:928:mgc_blocking_ast()) ### MGC cancel CB ns: MGC192.168.203.113@tcp lock: ffff9f2788f44400/0x872d29295eb47d9d lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1409400000000 nid: local remote: 0x872d29295eb47da4 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:0.0:1787365401.062859:0:14396:0:(mgc_request.c:932:mgc_blocking_ast()) Lock res [0x736d61726170:0x3:0x0].0x0 (params) 00010000:00010000:0.0:1787365401.062874:0:14396:0:(ldlm_request.c:1439:__ldlm_pack_lock()) ### packing ns: MGC192.168.203.113@tcp lock: ffff9f2788f44400/0x872d29295eb47d9d lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb47da4 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.062880:0:14396:0:(ldlm_request.c:1498:ldlm_cancel_pack()) 1 locks packed 00010000:00010000:0.0:1787365401.062897:0:14396:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGC192.168.203.113@tcp lock: ffff9f2788f44400/0x872d29295eb47d9d lrc: 1/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb47da4 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.062903:0:14396:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGC192.168.203.113@tcp lock: ffff9f2788f44400/0x872d29295eb47d9d lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x5c09400000020 nid: local remote: 0x872d29295eb47da4 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.062917:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365401.062919:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365401.062921:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365401.062929:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365401.062952:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3310:1874188024522240:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787365401.062992:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365401.063028:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787365401.063034:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3310:1874188024522368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787365401.063067:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365401.063097:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3312:1874188024522496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787365401.063124:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365401.063167:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024522240 00000100:00100000:0.0:1787365401.063172:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024522240 00010000:00010000:0.0:1787365401.063196:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f2798114600/0x872d29295eb47f2c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb47f25 expref: 19 pid: 14402 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365401.063211:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024522368 00000100:00100000:0.0:1787365401.063213:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024522368 00010000:00010000:0.0:1787365401.063223:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f27b6e23c00/0x872d29295eb47df1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb47dea expref: 20 pid: 14401 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365401.063232:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024522496 00000100:00100000:0.0:1787365401.063234:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024522496 00010000:00010000:0.0:1787365401.063243:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f27b6e23000/0x872d29295eb47da4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb47d9d expref: 21 pid: 14401 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365401.063255:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787365401.063262:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+21:3310:x1874188024522240:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787365401.063275:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365401.063281:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f2798114600/0x872d29295eb47f2c lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb47f25 expref: 21 pid: 14402 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.063290:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f2798114600/0x872d29295eb47f2c lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb47f25 expref: 21 pid: 14402 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.063311:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365401.063343:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c5f80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+21:3310:x1874188024522240:12345-0@lo:103:ldlm_bl.0 Request processed in 81us (350us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365401.063359:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 4 00000100:00100000:0.0:1787365401.063374:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787365401.063380:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+20:3310:x1874188024522368:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787365401.063388:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365401.063394:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f27b6e23c00/0x872d29295eb47df1 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb47dea expref: 20 pid: 14401 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.063401:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f27b6e23c00/0x872d29295eb47df1 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb47dea expref: 20 pid: 14401 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.063411:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365401.063434:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c4700 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+20:3310:x1874188024522368:12345-0@lo:103:ldlm_bl.0 Request processed in 54us (366us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365401.063440:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 5 00000100:00100000:0.0:1787365401.063452:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787365401.063457:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bac91450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:3312:x1874188024522496:12345-0@lo:103:ldlm_bl.0 00010000:00010000:0.0:1787365401.063465:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365401.063469:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f27b6e23000/0x872d29295eb47da4 lrc: 5/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x60000400000020 nid: 0@lo remote: 0x872d29295eb47d9d expref: 19 pid: 14401 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.063477:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f27b6e23000/0x872d29295eb47da4 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 8 type: PLN flags: 0x50000400000020 nid: 0@lo remote: 0x872d29295eb47d9d expref: 19 pid: 14401 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365401.063486:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365401.063511:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bac91450 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:3312:x1874188024522496:12345-0@lo:103:ldlm_bl.0 Request processed in 53us (386us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365401.063517:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 6 00000100:00100000:0.0:1787365401.063584:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c5c00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3312:1874188024522496:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787365401.063656:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c4000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3310:1874188024522368:0@lo:103:ldlm_bl.0 00000100:00100000:0.0:1787365401.063667:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c7100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3310:1874188024522240:0@lo:103:ldlm_bl.0 00010000:00010000:3.0:1787365401.064802:0:16522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2798114600/0x872d29295eb47f2c lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 7 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb47f25 expref: 18 pid: 14402 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365401.064818:0:16522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279808d500 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16522:1874188024521856:0@lo:104: 00010000:00010000:3.0:1787365401.064844:0:16522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27b6e23c00/0x872d29295eb47df1 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb47dea expref: 17 pid: 14401 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365401.065003:0:16522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279808f480 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16522:1874188024521984:0@lo:104: 00010000:00010000:3.0:1787365401.065017:0:16522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27b6e23000/0x872d29295eb47da4 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 0@lo remote: 0x872d29295eb47d9d expref: 16 pid: 14401 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365401.065024:0:16522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279808c700 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16522:1874188024522112:0@lo:104: 00000100:00100000:3.0:1787365401.068008:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365401.068074:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365401.068214:0:16522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279808f100 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16522:1874188024521600:192.168.203.13@tcp:104: 00000100:00100000:2.0:1787365401.068227:0:16522:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279808ca80 pname:cluuid:pid:xid:nid:opc:job lctl:MGS:16522:1874188024521728:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365401.068273:0:16522:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: MGS lock: ffff9f27a12cd200/0x872d29295eb480ad lrc: 3/0,1 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365401.068364:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003556992 00000100:00100000:1.0:1787365401.068372:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003556992 00010000:00010000:1.0:1787365401.068410:0:14393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f2788f45200/0x872d29295eb48083 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989456 expref: 13 pid: 14403 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365401.068448:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003557120 00000100:00100000:1.0:1787365401.068451:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003557120 00010000:00010000:1.0:1787365401.068464:0:14393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: MGS lock: ffff9f27c2045800/0x872d29295eb4804b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989893f4 expref: 14 pid: 14401 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365401.068491:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1787365401.068501:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+14:2361:x1874188003556992:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365401.068518:0:14393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365401.068524:0:14393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f2788f45200/0x872d29295eb48083 lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989456 expref: 14 pid: 14403 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365401.068537:0:14393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f2788f45200/0x872d29295eb48083 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989456 expref: 14 pid: 14403 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365401.068558:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f2788f45200/0x872d29295eb48083 lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989456 expref: 14 pid: 14403 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365401.068585:0:14393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365401.068678:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be7480 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+13:2361:x1874188003556992:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 178us (693us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365401.068687:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1787365401.068704:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1787365401.068711:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+12:2361:x1874188003557120:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365401.068718:0:14393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365401.068748:0:14393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: MGS lock: ffff9f27c2045800/0x872d29295eb4804b lrc: 4/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989893f4 expref: 12 pid: 14401 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365401.068757:0:14393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: MGS lock: ffff9f27c2045800/0x872d29295eb4804b lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989893f4 expref: 12 pid: 14401 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365401.068768:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27c2045800/0x872d29295eb4804b lrc: 0/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989893f4 expref: 12 pid: 14401 timeout: 618 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365401.068782:0:14393:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: MGS lock: ffff9f27a12cd200/0x872d29295eb480ad lrc: 3/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365401.068791:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a12cd200/0x872d29295eb480ad lrc: 4/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40290000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365401.068807:0:14393:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f27a12cd200/0x872d29295eb480ad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210000000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365401.068816:0:14393:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: MGS lock: ffff9f27a12cd200/0x872d29295eb480ad lrc: 5/0,1 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365401.068822:0:14393:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: MGS lock: ffff9f27a12cd200/0x872d29295eb480ad lrc: 4/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50210400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365401.068828:0:14393:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: MGS lock: ffff9f27a12cd200/0x872d29295eb480ad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365401.068834:0:14393:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cd200 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365401.068838:0:14393:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: MGS lock: ffff9f27a12cd200/0x872d29295eb480ad lrc: 5/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40210400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365401.068847:0:14393:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: MGS lock: ffff9f27a12cd200/0x872d29295eb480ad lrc: 6/0,0 mode: EX/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40218400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365401.068863:0:14393:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: MGS lock: ffff9f27a12cd200/0x872d29295eb480ad lrc: 4/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365401.068872:0:14393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365401.068890:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be5180 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+11:2361:x1874188003557120:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 179us (816us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365401.068896:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00010000:00010000:2.0:1787365401.069178:0:16522:0:(ldlm_request.c:190:ldlm_completion_tail()) ### client-side enqueue: destroyed ns: MGS lock: ffff9f27a12cd200/0x872d29295eb480ad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365401.069187:0:16522:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: MGS lock: ffff9f27a12cd200/0x872d29295eb480ad lrc: 1/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365401.069193:0:16522:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: MGS lock: ffff9f27a12cd200/0x872d29295eb480ad lrc: 0/0,0 mode: --/EX res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x44a19400000000 nid: local remote: 0x0 expref: -99 pid: 16522 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365401.277471:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365402.291152:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:0.0:1787365402.611506:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365402.611786:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003557248 00000100:00100000:2.0:1787365402.611796:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003557248 00000100:00100000:2.0:1787365402.611854:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 106 00000100:00100000:2.0:1787365402.611864:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+11:13773:x1874188003557248:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:2.0:1787365402.611879:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365402.611898:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27a12cc600/0x872d29295eb480b4 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989487 expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365402.611926:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27a12cc600/0x872d29295eb480b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989487 expref: 12 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365402.611966:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27a12cc600/0x872d29295eb480b4 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989487 expref: 12 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365402.611974:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cc600, rc 0) 00000100:00100000:2.0:1787365402.612041:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787927c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+12:13773:x1874188003557248:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 180us (545us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365402.612048:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 106 00000100:00100000:1.0:1787365402.634184:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365402.634257:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003557376 00000100:00100000:2.0:1787365402.634266:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003557376 00000100:00100000:2.0:1787365402.634326:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 107 00000100:00100000:2.0:1787365402.634337:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+12:13773:x1874188003557376:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:2.0:1787365402.634622:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787925850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+12:13773:x1874188003557376:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 285us (446us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365402.634655:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 107 00000100:00100000:1.0:1787365402.653680:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365402.653962:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003557504 00000100:00100000:3.0:1787365402.653971:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003557504 00000100:00100000:3.0:1787365402.654024:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:3.0:1787365402.654034:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+12:13773:x1874188003557504:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787365402.654284:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787925450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+12:13773:x1874188003557504:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 250us (611us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365402.654293:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 108 00000100:00100000:2.0:1787365402.670705:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365402.670918:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003557632 00000100:00100000:3.0:1787365402.670927:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003557632 00000100:00100000:3.0:1787365402.670999:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 109 00000100:00100000:3.0:1787365402.671010:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+12:13773:x1874188003557632:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787365402.671026:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365402.671044:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2788f45600/0x872d29295eb480bb lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898948e expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365402.671073:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2788f45600/0x872d29295eb480bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898948e expref: 13 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365402.671099:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2788f45600/0x872d29295eb480bb lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898948e expref: 13 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365402.671108:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45600, rc 0) 00000100:00100000:3.0:1787365402.671171:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787926450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+13:13773:x1874188003557632:12345-192.168.203.13@tcp:101:ll_cfg_requeue.0 Request processed in 163us (475us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365402.671178:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 109 00000100:00100000:2.0:1787365402.677360:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365402.678947:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003557760 00000100:00100000:3.0:1787365402.678958:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003557760 00000100:00100000:3.0:1787365402.679015:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 110 00000100:00100000:3.0:1787365402.679025:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+13:13773:x1874188003557760:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365402.679287:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787925c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+13:13773:x1874188003557760:12345-192.168.203.13@tcp:501:ll_cfg_requeue.0 Request processed in 262us (1958us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365402.679296:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 110 10000000:01000000:3.0:1787365402.682598:0:14405:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787365402.682605:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f268673a000 from 10 10000000:01000000:3.0:1787365402.682611:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787365402.682686:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2788f45c00/0x872d29295eb480c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365402.682699:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2788f45c00/0x872d29295eb480c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365402.682709:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2788f45c00/0x872d29295eb480c2 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365402.682731:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6be4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024522624:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787365402.682806:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365402.683115:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b690bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787365402.683149:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024522624 00000100:00100000:3.0:1787365402.683156:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024522624 00000100:00100000:3.0:1787365402.683196:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787365402.683205:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+16:14405:x1874188024522624:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787365402.683218:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365402.683231:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2788f44800/0x872d29295eb480c9 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb480c2 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365402.683253:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2788f44800/0x872d29295eb480c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb480c2 expref: 17 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365402.683263:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2788f44800/0x872d29295eb480c9 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb480c2 expref: 17 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365402.683271:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44800, rc 0) 00000100:00100000:3.0:1787365402.683308:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787924c50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+17:14405:x1874188024522624:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 103us (501us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365402.683314:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 111 00000100:00100000:3.0:1787365402.683354:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6be4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024522624:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787365402.683368:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2788f45c00/0x872d29295eb480c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb480c9 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365402.683377:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2788f45c00/0x872d29295eb480c2 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb480c9 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365402.683424:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6be4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024522752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365402.683453:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365402.683466:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b690bd80 going to sleep for 11 seconds 00000100:00100000:3.0:1787365402.683478:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024522752 00000100:00100000:3.0:1787365402.683481:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024522752 00000100:00100000:3.0:1787365402.683500:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787365402.683507:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2787924050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+17:14405:x1874188024522752:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365402.683760:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2787924050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+17:14405:x1874188024522752:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 241us (294us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365402.683768:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 112 00000100:00100000:3.0:1787365402.683799:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6be4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024522752:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365402.683825:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6be4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024522880:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787365402.689158:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365402.689206:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b690bd80 going to sleep for 11 seconds 00000100:00100000:1.0:1787365402.689318:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365402.689365:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024522880 00000100:00100000:0.0:1787365402.689373:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024522880 00000100:00100000:0.0:1787365402.689421:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003557888 00000100:00100000:0.0:1787365402.689424:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003557888 00000100:00100000:0.0:1787365402.689439:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 113 00000100:00100000:0.0:1787365402.689447:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+17:14405:x1874188024522880:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787365402.689655:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:1.0:1787365402.689665:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+13:13773:x1874188003557888:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 00000100:00100000:1.0:1787365402.690192:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65ad050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+13:13773:x1874188003557888:12345-192.168.203.13@tcp:503:ll_cfg_requeue.0 Request processed in 528us (874us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365402.690202:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 114 00000100:00100000:0.0:1787365402.693417:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65acc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+17:14405:x1874188024522880:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 3963us (4258us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365402.693430:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 113 00000100:00100000:3.0:1787365402.697859:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6be4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024522880:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787365402.715955:0:16565:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:1.0:1787365402.716237:0:14405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:1.0:1787365402.716257:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:1.0:1787365402.716268:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2788f45c00/0x872d29295eb480c2 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb480c9 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365402.716280:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2788f45c00/0x872d29295eb480c2 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 2 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb480c9 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:1.0:1787365402.716290:0:14405:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:1.0:1787365402.716293:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f2794eb2000 from 10 10000000:01000000:1.0:1787365402.716296:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:1.0:1787365402.716358:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2798114600/0x872d29295eb480d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365402.716365:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2798114600/0x872d29295eb480d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365402.716376:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2798114600/0x872d29295eb480d0 lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365402.716402:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb40ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024523008:0@lo:101:ll_cfg_requeue.0 00000100:00100000:1.0:1787365402.716466:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365402.716505:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2787828300 going to sleep for 11 seconds 00000100:00100000:1.0:1787365402.716525:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024523008 00000100:00100000:1.0:1787365402.717158:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024523008 00000100:00100000:1.0:1787365402.717218:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787365402.717227:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+17:14405:x1874188024523008:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787365402.717244:0:14402:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365402.717259:0:14402:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f2798115c00/0x872d29295eb480d7 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb480d0 expref: -99 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365402.717286:0:14402:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f2798115c00/0x872d29295eb480d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb480d0 expref: 18 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365402.717297:0:14402:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f2798115c00/0x872d29295eb480d7 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 5 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb480d0 expref: 18 pid: 14402 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365402.717306:0:14402:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115c00, rc 0) 00000100:00100000:1.0:1787365402.717377:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65af050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+18:14405:x1874188024523008:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 151us (911us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365402.717384:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 115 00000100:00100000:1.0:1787365402.717451:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb40ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024523008:0@lo:101:ll_cfg_requeue.0 00010000:00010000:1.0:1787365402.717467:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2798114600/0x872d29295eb480d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb480d7 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365402.717476:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2798114600/0x872d29295eb480d0 lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb480d7 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365402.718157:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb40ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024523136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:1.0:1787365402.718193:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365402.718231:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2787828300 going to sleep for 11 seconds 00000100:00100000:3.0:1787365402.718302:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024523136 00000100:00100000:3.0:1787365402.718307:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024523136 00000100:00100000:3.0:1787365402.718346:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787365402.718354:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+18:14405:x1874188024523136:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365402.721300:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65af450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+18:14405:x1874188024523136:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 2939us (3098us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365402.721313:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 116 00000100:00100000:3.0:1787365402.721370:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb40ad80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024523136:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365402.721425:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6be4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024523264:0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787365402.721471:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365402.721496:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b690b480 going to sleep for 11 seconds 00000100:00100000:3.0:1787365402.721512:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024523264 00000100:00100000:3.0:1787365402.721530:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024523264 00000100:00100000:3.0:1787365402.721563:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787365402.721570:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+18:14405:x1874188024523264:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787365402.721910:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65adc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+18:14405:x1874188024523264:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 180us (279us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365402.721918:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 117 00000100:00100000:3.0:1787365402.721971:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6be4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024523264:0@lo:503:ll_cfg_requeue.0 00000040:00080000:2.0:1787365402.725524:0:16567:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787365402.736057:0:14405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787365402.736103:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787365402.736116:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2798114600/0x872d29295eb480d0 lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb480d7 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365402.736137:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2798114600/0x872d29295eb480d0 lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 3 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb480d7 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 10000000:01000000:3.0:1787365402.736147:0:14405:0:(mgc_request.c:611:do_requeue()) updating log params 10000000:01000000:3.0:1787365402.736150:0:14405:0:(mgc_request.c:1802:mgc_process_log()) Process log params-ffff9f27b63ba000 from 10 10000000:01000000:3.0:1787365402.736153:0:14405:0:(mgc_request.c:996:mgc_enqueue()) Enqueue for params (res 0x736d61726170) 00010000:00010000:3.0:1787365402.736190:0:14405:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2788f44a00/0x872d29295eb480de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x10000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365402.736199:0:14405:0:(ldlm_request.c:1107:ldlm_cli_enqueue()) ### client-side enqueue START, flags 0x1000000000000 ns: MGC192.168.203.113@tcp lock: ffff9f2788f44a00/0x872d29295eb480de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x0 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365402.736210:0:14405:0:(ldlm_request.c:1194:ldlm_cli_enqueue()) ### sending request ns: MGC192.168.203.113@tcp lock: ffff9f2788f44a00/0x872d29295eb480de lrc: 3/1,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x0 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365402.736235:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6be4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024523392:0@lo:101:ll_cfg_requeue.0 00000100:00100000:3.0:1787365402.736314:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365402.737958:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b690b480 going to sleep for 11 seconds 00000040:00080000:3.0:1787365402.740374:0:14442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:1.0:1787365402.740909:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024523392 00000100:00100000:1.0:1787365402.740920:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024523392 00000100:00100000:0.0:1787365402.741360:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 118 00000100:00100000:0.0:1787365402.741370:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+18:14405:x1874188024523392:12345-0@lo:101:ll_cfg_requeue.0 00010000:00010000:0.0:1787365402.741387:0:14401:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365402.741404:0:14401:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: MGS lock: ffff9f27c2044000/0x872d29295eb480e5 lrc: 2/0,0 mode: --/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: local remote: 0x872d29295eb480de expref: -99 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365402.741431:0:14401:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGS lock: ffff9f27c2044000/0x872d29295eb480e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x50000000000000 nid: 0@lo remote: 0x872d29295eb480de expref: 19 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365402.741442:0:14401:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: MGS lock: ffff9f27c2044000/0x872d29295eb480e5 lrc: 3/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 6 type: PLN flags: 0x40000000000000 nid: 0@lo remote: 0x872d29295eb480de expref: 19 pid: 14401 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365402.741450:0:14401:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27c2044000, rc 0) 00000100:00100000:0.0:1787365402.741515:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65ad850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:14405:x1874188024523392:12345-0@lo:101:ll_cfg_requeue.0 Request processed in 146us (5201us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365402.742098:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6be4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024523392:0@lo:101:ll_cfg_requeue.0 00010000:00010000:3.0:1787365402.742126:0:14405:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: MGC192.168.203.113@tcp lock: ffff9f2788f44a00/0x872d29295eb480de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb480e5 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365402.742136:0:14405:0:(ldlm_request.c:841:ldlm_cli_enqueue_fini()) ### client-side enqueue END ns: MGC192.168.203.113@tcp lock: ffff9f2788f44a00/0x872d29295eb480de lrc: 4/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x1000000000000 nid: local remote: 0x872d29295eb480e5 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365402.742204:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6be4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024523520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:3.0:1787365402.742244:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365402.742271:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b690b480 going to sleep for 11 seconds 00000100:00100000:3.0:1787365402.742286:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024523520 00000100:00100000:3.0:1787365402.742290:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024523520 00000100:00100000:3.0:1787365402.742310:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 119 00000100:00100000:3.0:1787365402.742316:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+20:14405:x1874188024523520:12345-0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787365402.742730:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 118 00000100:00100000:3.0:1787365402.742831:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65af850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:14405:x1874188024523520:12345-0@lo:501:ll_cfg_requeue.0 Request processed in 514us (586us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365402.742909:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 119 00000100:00100000:0.0:1787365402.743237:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6be4a80 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024523520:0@lo:501:ll_cfg_requeue.0 00000100:00100000:0.0:1787365402.743270:0:14405:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b63c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024523648:0@lo:503:ll_cfg_requeue.0 00000100:00100000:0.0:1787365402.743313:0:14405:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365402.743341:0:14405:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473fe40 going to sleep for 11 seconds 00000100:00100000:3.0:1787365402.743378:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024523648 00000100:00100000:3.0:1787365402.743381:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024523648 00000100:00100000:3.0:1787365402.743438:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 120 00000100:00100000:3.0:1787365402.743445:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:14405:x1874188024523648:12345-0@lo:503:ll_cfg_requeue.0 00000100:00100000:3.0:1787365402.743607:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65ac850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:14405:x1874188024523648:12345-0@lo:503:ll_cfg_requeue.0 Request processed in 162us (293us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365402.743662:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 120 00000100:00100000:1.0:1787365402.743733:0:14405:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b63c7100 pname:cluuid:pid:xid:nid:opc:job ll_cfg_requeue:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:14405:1874188024523648:0@lo:503:ll_cfg_requeue.0 00000040:00080000:1.0:1787365402.752404:0:16571:0:(llog.c:862:llog_process_thread()) stop processing plain [0xa:0x2:0x0] index 64768 count 10 00000020:01000000:3.0:1787365402.755263:0:14405:0:(obd_config.c:2145:class_config_parse_llog()) Processed log params gen 10-9 (rc=0) 10000000:01000000:3.0:1787365402.755293:0:14405:0:(mgc_request.c:1879:mgc_process_log()) MGC192.168.203.113@tcp: configuration from log 'params' succeeded (0). 00010000:00010000:3.0:1787365402.755305:0:14405:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: MGC192.168.203.113@tcp lock: ffff9f2788f44a00/0x872d29295eb480de lrc: 3/1,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb480e5 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365402.755317:0:14405:0:(ldlm_lock.c:919:ldlm_lock_decref_internal()) ### do not add lock into lru list ns: MGC192.168.203.113@tcp lock: ffff9f2788f44a00/0x872d29295eb480de lrc: 2/0,0 mode: CR/CR res: [0x736d61726170:0x3:0x0].0x0 rrc: 4 type: PLN flags: 0x11000000000000 nid: local remote: 0x872d29295eb480e5 expref: -99 pid: 14405 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365402.995431:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365402.995468:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365402.995489:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365402.995514:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365402.995539:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365402.995563:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365402.995587:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365402.995610:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003558016 00000100:00100000:3.0:1787365402.995619:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003558016 00000100:00100000:3.0:1787365402.995685:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:3.0:1787365402.995696:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+13:2362:x1874188003558016:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1787365402.996042:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003558144 00000100:00100000:2.0:1787365402.996047:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003558144 00000100:00100000:2.0:1787365402.996084:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003558528 00000100:00100000:2.0:1787365402.996087:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003558528 00000100:00100000:3.0:1787365402.996171:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65ac050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+13:2362:x1874188003558016:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 476us (654us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365402.996180:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 121 00000100:00100000:3.0:1787365402.996214:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003558400 00000100:00100000:3.0:1787365402.996218:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003558400 00000100:00100000:3.0:1787365402.996239:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003558656 00000100:00100000:3.0:1787365402.996242:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003558656 00000100:00100000:3.0:1787365402.996267:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003558272 00000100:00100000:3.0:1787365402.996271:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003558272 00000100:00100000:3.0:1787365402.996290:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003558784 00000100:00100000:3.0:1787365402.996293:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003558784 00000100:00100000:3.0:1787365402.996309:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1787365402.996317:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+5:2362:x1874188003558400:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365402.996350:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be4700 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+5:2362:x1874188003558400:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 34us (882us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365402.996356:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1787365402.996372:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1787365402.996379:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+5:2362:x1874188003558656:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365402.996406:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be6680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+5:2362:x1874188003558656:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 28us (916us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365402.996413:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1787365402.996427:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1787365402.996434:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+5:2362:x1874188003558272:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365402.996460:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be7800 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+5:2362:x1874188003558272:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 26us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365402.996466:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:3.0:1787365402.996479:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:3.0:1787365402.996485:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+5:2362:x1874188003558784:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365402.996508:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be5f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+5:2362:x1874188003558784:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 23us (920us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365402.996514:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:2.0:1787365402.996596:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:2.0:1787365402.996605:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+6:2362:x1874188003558144:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1787365402.996665:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be4e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+6:2362:x1874188003558144:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 60us (1241us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365402.996685:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:2.0:1787365402.996706:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:2.0:1787365402.996716:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+6:2362:x1874188003558528:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:2.0:1787365402.996746:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+6:2362:x1874188003558528:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 33us (1183us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365402.996754:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00080000:2.0:1787365402.996797:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00080000:2.0:1787365402.996802:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787365402.996806:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787365403.315767:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365404.338883:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365404.533179:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787365404.533204:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024523776:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787365404.533277:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365404.533598:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279808f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024524160:0@lo:400:kworker.0 00000100:00100000:2.0:1787365404.533645:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365404.533666:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [3->2] 00000100:00100000:2.0:1787365404.533671:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279808d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024524288:0@lo:400:kworker.0 00000100:00100000:2.0:1787365404.533693:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365404.533719:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024524160 00000100:00100000:2.0:1787365404.533725:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024524160 00000100:00100000:2.0:1787365404.533765:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024524288 00000100:00100000:2.0:1787365404.533767:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024524288 00000100:00100000:2.0:1787365404.533794:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787365404.533802:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024524160:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365404.533850:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808df80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024524160:12345-0@lo:400:kworker.0 Request processed in 48us (204us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365404.533872:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 26 00000100:00100000:2.0:1787365404.533887:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 27 00000100:00100000:2.0:1787365404.533892:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024524288:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365404.533915:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808ce00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024524288:12345-0@lo:400:kworker.0 Request processed in 24us (222us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365404.533921:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 27 00000100:00080000:2.0:1787365404.533940:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365404.533965:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279808d500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024524288:0@lo:400:kworker.0 00000100:00100000:2.0:1787365404.533974:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279808f480 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024524160:0@lo:400:kworker.0 00000100:00100000:3.0:1787365404.534077:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024523776 00000100:00100000:3.0:1787365404.534086:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024523776 00000100:00100000:3.0:1787365404.534127:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 12 00000100:00100000:3.0:1787365404.534134:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024523776:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:3.0:1787365404.534159:0:15095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365404.534194:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808ca80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024523776:12345-0@lo:13:osp-pre-1-0.0 Request processed in 61us (918us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365404.534200:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 12 00000100:00080000:3.0:1787365404.534227:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:3.0:1787365404.534256:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb409180 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024523776:0@lo:13:osp-pre-1-0.0 00000100:00100000:0.0:1787365404.534349:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279808f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3310:1874188024523904:0@lo:400:kworker.0 00000100:00100000:0.0:1787365404.534379:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365404.534400:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279808c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874188024524416:0@lo:400:kworker.0 00000100:00100000:0.0:1787365404.534417:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365404.534434:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:0.0:1787365404.534439:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279808c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024524032:0@lo:400:kworker.0 00000100:00100000:0.0:1787365404.534461:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365404.534488:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024524032 00000100:00100000:0.0:1787365404.534491:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024524032 00000100:00100000:0.0:1787365404.534523:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:0.0:1787365404.534529:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024524032:12345-0@lo:400:kworker.0 00000100:00100000:0.0:1787365404.534562:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c5c00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024524032:12345-0@lo:400:kworker.0 Request processed in 33us (100us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365404.534568:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00080000:0.0:1787365404.534585:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:0.0:1787365404.534600:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279808c700 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024524032:0@lo:400:kworker.0 00000100:00100000:2.0:1787365404.534911:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024524416 00000100:00100000:2.0:1787365404.534915:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024524416 00000100:00100000:2.0:1787365404.534939:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 28 00000100:00100000:2.0:1787365404.534944:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874188024524416:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365404.534973:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c4000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874188024524416:12345-0@lo:400:kworker.0 Request processed in 29us (555us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365404.534978:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 28 00000100:00100000:3.0:1787365404.535260:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024523904 00000100:00100000:3.0:1787365404.535264:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024523904 00000100:00080000:0.0:1787365404.535478:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:0.0:1787365404.535500:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279808c000 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874188024524416:0@lo:400:kworker.0 00000100:00100000:2.0:1787365404.539265:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 122 00000100:00100000:2.0:1787365404.539285:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:3310:x1874188024523904:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365404.539384:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65ad450 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:3310:x1874188024523904:12345-0@lo:400:kworker.0 Request processed in 107us (5002us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365404.539392:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 122 00000100:00100000:3.0:1787365404.539486:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279808f100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3310:1874188024523904:0@lo:400:kworker.0 00000100:00100000:3.0:1787365405.047400:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787365405.047419:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024524544:0@lo:13:osp-pre-0-0.0 00000100:00100000:3.0:1787365405.047482:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365405.047543:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024524544 00000100:00100000:3.0:1787365405.047550:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024524544 00000100:00100000:3.0:1787365405.047590:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787365405.047598:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024524544:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:3.0:1787365405.047653:0:15095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:3.0:1787365405.047692:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be6300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024524544:12345-0@lo:13:osp-pre-0-0.0 Request processed in 95us (211us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365405.047699:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 13 00000100:00100000:3.0:1787365405.047742:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6be6a00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024524544:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787365405.363657:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365405.526316:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365405.526513:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003558912 00000100:00100000:2.0:1787365405.526523:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003558912 00000100:00100000:2.0:1787365405.526590:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:2.0:1787365405.526610:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+6:14431:x1874188003558912:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365405.526661:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365405.526681:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb480ec lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989495 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.526735:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb480f3 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.526749:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb480f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.526770:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb480f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.526784:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb480fa lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.526791:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb480fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.526796:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb480fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00080000:0.0:1787365405.526897:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:2.0:1787365405.527982:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb48101 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.527998:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb48101 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.528007:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb48101 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365405.528121:0:14410:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x1:0x0]: returning size 6656 00000004:00200000:2.0:1787365405.528125:0:14410:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 2 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365405.528218:0:14410:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb48101 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.528229:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb480f3 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.528235:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb480f3 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.528241:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb480f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.528246:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cc800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365405.528250:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb480f3 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.528257:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb480f3 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.528269:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2789e48c00) 00010000:00010000:2.0:1787365405.528272:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365405.528276:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb480f3 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.528282:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb480f3 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.528293:0:14410:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb480fa lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.529001:0:14410:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb480fa lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.529007:0:14410:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb480fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.529012:0:14410:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cd200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365405.529015:0:14410:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb480fa lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.529021:0:14410:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb480fa lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.529029:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x3b979c7a (ffff9f27838b1100) 00010000:00010000:2.0:1787365405.529032:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365405.529035:0:14410:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb480fa lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.529040:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb480fa lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x3b979c7a bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.529081:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb480ec lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989495 expref: 8 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.529094:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd800/0x872d29295eb48101 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989495 expref: 7 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.529112:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f27838b1400) 00010000:00010000:2.0:1787365405.529114:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787365405.529123:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cd800, rc 0) 00000100:00100000:2.0:1787365405.529193:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+7:14431:x1874188003558912:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 2583us (2902us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365405.529201:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:1.0:1787365405.546273:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365405.546446:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003559168 00000100:00100000:2.0:1787365405.546456:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003559168 00000100:00100000:2.0:1787365405.546504:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:2.0:1787365405.546514:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb40b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+7:14431:x1874188003559168:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365405.546531:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365405.546549:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48108 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898949c expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.546617:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc200/0x872d29295eb4810f lrc: 3/1,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.546664:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc200/0x872d29295eb4810f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.546675:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc200/0x872d29295eb4810f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.546729:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cde00/0x872d29295eb48116 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.546738:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cde00/0x872d29295eb48116 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.546745:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cde00/0x872d29295eb48116 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.547280:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb4811d lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.547295:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb4811d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.547472:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb4811d lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365405.547483:0:14409:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000002:0x2:0x0]: returning size 6656 00010000:00010000:2.0:1787365405.547766:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc200/0x872d29295eb4810f lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.547774:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc200/0x872d29295eb4810f lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.547780:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc200/0x872d29295eb4810f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.547786:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cc200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365405.547790:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc200/0x872d29295eb4810f lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.547797:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc200/0x872d29295eb4810f lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.547822:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x0 (ffff9f27838b1400) 00010000:00010000:2.0:1787365405.547825:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365405.547830:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc200/0x872d29295eb4810f lrc: 2/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.547837:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc200/0x872d29295eb4810f lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.547849:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cde00/0x872d29295eb48116 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.547861:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cde00/0x872d29295eb48116 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.547867:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cde00/0x872d29295eb48116 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.547872:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cde00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365405.547875:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cde00/0x872d29295eb48116 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.547881:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cde00/0x872d29295eb48116 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.547889:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x1:0x0].0x8d45d6bc (ffff9f27838b1e00) 00010000:00010000:2.0:1787365405.547892:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365405.547895:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cde00/0x872d29295eb48116 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.547900:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cde00/0x872d29295eb48116 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x1:0x0].0x8d45d6bc bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.548251:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48108 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898949c expref: 10 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.548265:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12ccc00/0x872d29295eb4811d lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898949c expref: 9 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.548272:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f27838b1200) 00010000:00010000:2.0:1787365405.548274:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365405.548280:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12ccc00, rc 0) 00000100:00100000:2.0:1787365405.549143:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb40b100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+9:14431:x1874188003559168:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 2627us (2875us total) trans 8589934593 rc 0/0 00000100:00100000:2.0:1787365405.549152:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1787365405.557561:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365405.557690:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003559296 00000100:00100000:2.0:1787365405.557699:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003559296 00000100:00100000:2.0:1787365405.557745:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:2.0:1787365405.557768:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+9:14431:x1874188003559296:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 00000100:00100000:2.0:1787365405.557875:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c5f80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+9:14431:x1874188003559296:12345-192.168.203.13@tcp:59:lhsmtool_posix.0 Request processed in 109us (323us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365405.557882:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:2.0:1787365405.672582:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365405.672692:0:15822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003559424 00000100:00100000:0.0:1787365405.672701:0:15822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003559424 00000100:00100000:0.0:1787365405.672767:0:15822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:0.0:1787365405.672776:0:15822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f02bb255-97c1-4c08-8e1d-6c853c05ec45+9:14437:x1874188003559424:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1787365405.672798:0:15822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365405.672827:0:15822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4812b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989894a3 expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.672892:0:15822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb48132 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.672907:0:15822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb48132 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.672918:0:15822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb48132 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.672934:0:15822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb48139 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.672942:0:15822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb48139 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.672948:0:15822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb48139 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.673228:0:15822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb48132 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.673247:0:15822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb48132 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.673254:0:15822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb48132 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.673260:0:15822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2045a00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365405.673264:0:15822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb48132 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.673272:0:15822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb48132 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.673284:0:15822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2789e48c00) 00010000:00010000:0.0:1787365405.673287:0:15822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365405.673292:0:15822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb48132 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.676022:0:15822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb48132 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.676184:0:15822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb48139 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.676192:0:15822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb48139 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.676199:0:15822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb48139 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.676205:0:15822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2045400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365405.676222:0:15822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb48139 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.676230:0:15822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb48139 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.676245:0:15822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f278a0ade00) 00010000:00010000:0.0:1787365405.676248:0:15822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365405.676252:0:15822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb48139 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.676257:0:15822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb48139 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.676461:0:15822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4812b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894a3 expref: 10 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.676475:0:15822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2789e48c00) 00010000:00010000:0.0:1787365405.676477:0:15822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365405.676482:0:15822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb4812b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894a3 expref: 10 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.676493:0:15822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27c2045800, rc 0) 00000100:00100000:0.0:1787365405.676744:0:15822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808f480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f02bb255-97c1-4c08-8e1d-6c853c05ec45+9:14437:x1874188003559424:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 3967us (4168us total) trans 0 rc 301/301 00000100:00100000:0.0:1787365405.676766:0:15822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:1.0:1787365405.688545:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365405.688670:0:14417:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003559552 00000100:00100000:2.0:1787365405.688677:0:14417:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003559552 00000100:00100000:2.0:1787365405.688724:0:14417:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:2.0:1787365405.688734:0:14417:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+9:14437:x1874188003559552:12345-192.168.203.13@tcp:700:lfs.0 00000100:00100000:2.0:1787365405.689012:0:14417:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb409880 pname:cluuid+ref:pid:xid:nid:opc:job mdt_seqm_0000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+9:14437:x1874188003559552:12345-192.168.203.13@tcp:700:lfs.0 Request processed in 277us (473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365405.689020:0:14417:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:3.0:1787365405.695157:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365405.696073:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003559808 00000100:00100000:2.0:1787365405.696084:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003559808 00000100:00100000:2.0:1787365405.696160:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:2.0:1787365405.696170:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+9:14437:x1874188003559808:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:2.0:1787365405.696461:0:14408:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365405.696486:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb4806e lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898941e expref: 9 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.696520:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2789e48c00) 00010000:00010000:2.0:1787365405.696525:0:14408:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787365405.696935:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48140 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.696951:0:14408:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb480a6 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989480 expref: 5 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.696959:0:14408:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48140 lrc: 4/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.696990:0:14408:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb480a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989480 expref: 5 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.697002:0:14408:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb480a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989480 expref: 5 pid: 14410 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365405.697016:0:14408:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279808d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14408:1874188024524672:192.168.203.13@tcp:104: 00000100:00100000:2.0:1787365405.697227:0:14408:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878bea80 going to sleep for 11 seconds 00000100:00100000:2.0:1787365405.702321:0:14408:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279808d500 pname:cluuid:pid:xid:nid:opc:job mdt00_000:lustre-MDT0000_UUID:14408:1874188024524672:192.168.203.13@tcp:104: 00010000:00010000:2.0:1787365405.702352:0:14408:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48140 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365405.704335:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365405.704482:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003559936 00000100:00100000:1.0:1787365405.704491:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003559936 00010000:00010000:1.0:1787365405.704544:0:14393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb480a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989480 expref: 6 pid: 14410 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365405.704583:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1787365405.704592:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+6:2361:x1874188003559936:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:1.0:1787365405.704607:0:14393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:1.0:1787365405.704614:0:14393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb480a6 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989480 expref: 6 pid: 14410 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365405.704668:0:14393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb480a6 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989480 expref: 6 pid: 14410 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365405.704689:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2798114400/0x872d29295eb480a6 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989480 expref: 6 pid: 14410 timeout: 622 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365405.704703:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2789e48c00) 00010000:00010000:1.0:1787365405.704709:0:14393:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48140 lrc: 3/0,1 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365405.704716:0:14393:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48140 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365405.704724:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48140 lrc: 4/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365405.704744:0:14393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:1.0:1787365405.704806:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be5500 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+5:2361:x1874188003559936:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 214us (477us total) trans 0 rc 0/0 00000100:00080000:0.0:1787365405.704898:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00010000:00010000:3.0:1787365405.706859:0:14408:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48140 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365405.706880:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48140 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365405.706918:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb48147 lrc: 3/0,1 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365405.706933:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb48147 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365405.706946:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb48147 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365405.708767:0:14408:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787365405.708788:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48140 lrc: 3/0,1 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365405.708799:0:14408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48140 lrc: 2/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365405.708807:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48140 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365405.708814:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cce00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365405.708819:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48140 lrc: 3/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365405.708828:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48140 lrc: 4/0,0 mode: CW/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365405.708860:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f2789e48c00) 00010000:00010000:3.0:1787365405.708864:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365405.708870:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48140 lrc: 2/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365405.708877:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48140 lrc: 0/0,0 mode: --/CW res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787365405.708903:0:14408:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000008b89f6c2 reply state 00000000f19fdbfd transno 8589934594 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb48147 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365405.708914:0:14408:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787365405.709055:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be6d80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+10:14437:x1874188003559808:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 12880us (13900us total) trans 8589934594 rc 0/0 00000100:00100000:3.0:1787365405.709066:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:1.0:1787365405.710020:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00010000:00010000:0.0:1787365405.724994:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb48147 lrc: 3/0,1 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.725035:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb48147 lrc: 2/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.725042:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb48147 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.725049:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365405.725054:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb48147 lrc: 3/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.725063:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb48147 lrc: 4/0,0 mode: PW/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.725083:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f2789e48b00) 00010000:00010000:0.0:1787365405.725087:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365405.725093:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb48147 lrc: 2/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365405.725111:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb48147 lrc: 0/0,0 mode: --/PW res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787365405.812326:0:14442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 64768 count 1 00000100:00100000:0.0:1787365405.936254:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365405.936403:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003560064 00000100:00100000:2.0:1787365405.936418:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003560064 00000100:00100000:2.0:1787365405.936506:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:2.0:1787365405.936532:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+9:14445:x1874188003560064:12345-192.168.203.13@tcp:101:lctl.0 00010000:00010000:2.0:1787365405.936594:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365405.936687:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cde00/0x872d29295eb4814e lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989894aa expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.936807:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc200/0x872d29295eb48155 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.937289:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc200/0x872d29295eb48155 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365405.937310:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc200/0x872d29295eb48155 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365405.937955:0:14409:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:3.0:1787365405.937961:0:14409:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:3.0:1787365405.938026:0:14409:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc200/0x872d29295eb48155 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365405.938066:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cde00/0x872d29295eb4814e lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894aa expref: 11 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365405.938091:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc200/0x872d29295eb48155 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894aa expref: 10 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365405.938111:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f27838b1e00) 00010000:00010000:3.0:1787365405.938114:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:3.0:1787365405.938133:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cc200, rc 0) 00000100:00100000:3.0:1787365405.938278:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c4700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+10:14445:x1874188003560064:12345-192.168.203.13@tcp:101:lctl.0 Request processed in 1760us (2038us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365405.938290:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:3.0:1787365406.025802:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365406.025922:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003560192 00000100:00100000:0.0:1787365406.025940:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003560192 00000100:00100000:0.0:1787365406.026028:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1787365406.026041:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+5:14446:x1874188003560192:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:0.0:1787365406.026070:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365406.026109:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4815c lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989894b1 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365406.026219:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb48163 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365406.026237:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb48163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365406.026250:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb48163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365406.026328:0:14410:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000007:0x1:0x0]: returning size 7680 00000004:00200000:0.0:1787365406.026333:0:14410:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 4 stripe count 1 MDT count 1 00000004:00010000:0.0:1787365406.026366:0:14410:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb48163 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365406.026408:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4815c lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894b1 expref: 7 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365406.026433:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045a00/0x872d29295eb48163 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894b1 expref: 6 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365406.026443:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f27838b1e00) 00010000:00010000:0.0:1787365406.026446:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:0.0:1787365406.026450:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27c2045a00, rc 0) 00000100:00100000:0.0:1787365406.026548:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+6:14446:x1874188003560192:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 509us (764us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365406.026557:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:0.0:1787365406.042759:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365406.042907:0:15822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003560320 00000100:00100000:2.0:1787365406.042916:0:15822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003560320 00000100:00100000:2.0:1787365406.042978:0:15822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:2.0:1787365406.043003:0:15822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+6:14446:x1874188003560320:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1787365406.043024:0:15822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365406.043044:0:15822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb4816a lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989894b8 expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043117:0:15822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb48171 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043132:0:15822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb48171 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043144:0:15822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb48171 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043174:0:15822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb48178 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043182:0:15822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb48178 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043188:0:15822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb48178 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043360:0:15822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb4817f lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043369:0:15822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb4817f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043375:0:15822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb4817f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365406.043413:0:15822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787365406.043417:0:15822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365406.043440:0:15822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb4817f lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043465:0:15822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb48171 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043473:0:15822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb48171 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043479:0:15822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb48171 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043497:0:15822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cd200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365406.043501:0:15822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb48171 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043509:0:15822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb48171 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043521:0:15822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f27838b1e00) 00010000:00010000:2.0:1787365406.043524:0:15822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365406.043529:0:15822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb48171 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043535:0:15822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb48171 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043550:0:15822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb48178 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043556:0:15822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb48178 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043563:0:15822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb48178 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043569:0:15822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cc800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365406.043572:0:15822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb48178 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043578:0:15822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb48178 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043596:0:15822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f27838b1100) 00010000:00010000:2.0:1787365406.043598:0:15822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365406.043601:0:15822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb48178 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043607:0:15822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb48178 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043679:0:15822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb4816a lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894b8 expref: 8 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043694:0:15822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb4817f lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894b8 expref: 7 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.043701:0:15822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f27838b1600) 00010000:00010000:2.0:1787365406.043703:0:15822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787365406.043705:0:15822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cd400, rc 0) 00000100:00100000:2.0:1787365406.043761:0:15822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c4a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+7:14446:x1874188003560320:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 774us (1010us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365406.043769:0:15822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 22 00000100:00100000:1.0:1787365406.050155:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365406.050243:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003560576 00000100:00100000:3.0:1787365406.050254:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003560576 00000100:00100000:3.0:1787365406.050319:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:3.0:1787365406.050330:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+7:14446:x1874188003560576:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1787365406.050350:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365406.050368:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb48186 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989894bf expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365406.050494:0:14408:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787365406.050615:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb48186 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894bf expref: 9 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.050671:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f27838b1e00) 00010000:00010000:3.0:1787365406.050675:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787365406.050681:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb48186 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894bf expref: 9 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.050696:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45e00, rc 0) 00000100:00100000:3.0:1787365406.050754:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb408000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+8:14446:x1874188003560576:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 425us (608us total) trans 8589934595 rc 301/301 00000100:00100000:3.0:1787365406.050762:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 23 00000100:00100000:1.0:1787365406.060718:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365406.060928:0:15822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003560832 00000100:00100000:2.0:1787365406.060937:0:15822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003560832 00000100:00100000:2.0:1787365406.060994:0:15822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 24 00000100:00100000:2.0:1787365406.061006:0:15822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+8:14446:x1874188003560832:12345-192.168.203.13@tcp:36:lfs.0 00010000:00010000:2.0:1787365406.061063:0:15822:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365406.061094:0:15822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb4817f lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894b8 expref: 8 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.061143:0:15822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f27838b1600) 00010000:00010000:2.0:1787365406.061153:0:15822:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787365406.061177:0:15822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb48194 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.061191:0:15822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb48194 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.061201:0:15822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb48194 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787365406.061474:0:15822:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 000000003512fe56 reply state 00000000ff984b80 transno 8589934596 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb48194 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365406.061484:0:15822:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000004:00200000:2.0:1787365406.061498:0:15822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000100:00100000:2.0:1787365406.061593:0:15822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb409180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+9:14446:x1874188003560832:12345-192.168.203.13@tcp:36:lfs.0 Request processed in 589us (884us total) trans 8589934596 rc 0/0 00000100:00100000:2.0:1787365406.061601:0:15822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 24 00010000:00010000:3.0:1787365406.065680:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb48194 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.065714:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb48194 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.065722:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb48194 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.065729:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cca00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365406.065733:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb48194 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.065742:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb48194 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.065758:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f27838b1100) 00010000:00010000:3.0:1787365406.065761:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 22 00010000:00010000:3.0:1787365406.065766:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb48194 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.065772:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb48194 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x0 bits 0x22/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365406.071322:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365406.071749:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003561088 00000100:00100000:0.0:1787365406.071771:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003561088 00000100:00100000:0.0:1787365406.071840:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:0.0:1787365406.071850:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb40ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+8:14446:x1874188003561088:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:0.0:1787365406.072126:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb40ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+9:14446:x1874188003561088:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 277us (823us total) trans 8589934597 rc 0/0 00000100:00100000:0.0:1787365406.072135:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:2.0:1787365406.078272:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365406.079022:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003561344 00000100:00100000:3.0:1787365406.079033:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003561344 00000100:00100000:3.0:1787365406.079094:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:3.0:1787365406.079115:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+9:14446:x1874188003561344:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1787365406.079140:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365406.079160:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb4819b lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989894c6 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.079232:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481a2 lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.079259:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.079270:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.079285:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb481a9 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.079292:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb481a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.079298:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb481a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365406.079602:0:14408:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:3.0:1787365406.079733:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481a2 lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.079742:0:14408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481a2 lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.079748:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.079754:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365406.079757:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481a2 lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.079765:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481a2 lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.079787:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f27838b1e00) 00010000:00010000:3.0:1787365406.079802:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365406.079807:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481a2 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.079813:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481a2 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.080440:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb481a9 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.080508:0:14408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb481a9 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.080517:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb481a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.080523:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365406.080526:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb481a9 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.080533:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb481a9 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.080542:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f2789e48c00) 00010000:00010000:3.0:1787365406.080545:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365406.080549:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb481a9 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.080555:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb481a9 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.080608:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb4819b lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894c6 expref: 11 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.080619:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f27838b1e00) 00010000:00010000:3.0:1787365406.080621:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787365406.080661:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb4819b lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894c6 expref: 11 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.080671:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45e00, rc 0) 00000100:00100000:3.0:1787365406.080734:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808d500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+10:14446:x1874188003561344:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1622us (2470us total) trans 8589934598 rc 301/301 00000100:00100000:3.0:1787365406.080742:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 25 00000100:00100000:1.0:1787365406.094119:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365406.094245:0:15822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003561472 00000100:00100000:2.0:1787365406.094254:0:15822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003561472 00000100:00100000:2.0:1787365406.094352:0:15822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:2.0:1787365406.094364:0:15822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+10:14446:x1874188003561472:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1787365406.094388:0:15822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365406.094409:0:15822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb481b7 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989894cd expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.094528:0:15822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb481be lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.094542:0:15822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb481be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.094553:0:15822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb481be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365406.094603:0:15822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:2.0:1787365406.094608:0:15822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365406.094661:0:15822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb481be lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.094686:0:15822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb481b7 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894cd expref: 12 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.094704:0:15822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb481be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894cd expref: 11 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.094712:0:15822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f27838b1600) 00010000:00010000:2.0:1787365406.094715:0:15822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 13 00010000:00010000:2.0:1787365406.094718:0:15822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cd400, rc 0) 00000100:00100000:2.0:1787365406.094772:0:15822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb408380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+11:14446:x1874188003561472:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 410us (661us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365406.094779:0:15822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 26 00000100:00100000:1.0:1787365406.106797:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365406.106854:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003561600 00000100:00100000:0.0:1787365406.106863:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003561600 00000100:00100000:0.0:1787365406.106913:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:0.0:1787365406.106921:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+11:14446:x1874188003561600:12345-192.168.203.13@tcp:37:lfs.0 00000100:00100000:1.0:1787365406.114328:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf9180 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+11:14446:x1874188003561600:12345-192.168.203.13@tcp:37:lfs.0 Request processed in 7398us (7538us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365406.114356:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:1.0:1787365406.117733:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365406.117833:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003561856 00000100:00100000:3.0:1787365406.117841:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003561856 00000100:00100000:3.0:1787365406.117893:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:3.0:1787365406.117903:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b658e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+11:14446:x1874188003561856:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1787365406.118268:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b658e450 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+12:14446:x1874188003561856:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 366us (543us total) trans 8589934599 rc 0/0 00000100:00100000:3.0:1787365406.118277:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:2.0:1787365406.221197:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365406.221353:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003561984 00000100:00100000:3.0:1787365406.221365:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003561984 00000100:00100000:3.0:1787365406.221452:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:3.0:1787365406.221464:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+10:14452:x1874188003561984:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1787365406.221493:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365406.221521:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb481c5 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989894d4 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.221860:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb481cc lrc: 3/1,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.221880:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb481cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.221893:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb481cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.221910:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481d3 lrc: 3/1,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.221917:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.221925:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.222063:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb481da lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.222072:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb481da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.222080:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb481da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365406.222127:0:14408:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00000004:00200000:3.0:1787365406.222132:0:14408:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787365406.222371:0:14408:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb481da lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.222461:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb481cc lrc: 3/1,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.222468:0:14408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb481cc lrc: 2/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.222476:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb481cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.222482:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f44000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365406.222487:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb481cc lrc: 3/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.222496:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb481cc lrc: 4/0,0 mode: CR/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.222509:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f27838b1e00) 00010000:00010000:3.0:1787365406.222513:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365406.222518:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb481cc lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.222525:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb481cc lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.222541:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481d3 lrc: 3/1,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.222548:0:14408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481d3 lrc: 2/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.222553:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.222566:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365406.222569:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481d3 lrc: 3/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.222576:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481d3 lrc: 4/0,0 mode: PR/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.222584:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0xab43d606 (ffff9f2789e48c00) 00010000:00010000:3.0:1787365406.222586:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365406.222589:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481d3 lrc: 2/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.222595:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481d3 lrc: 0/0,0 mode: --/PR res: [0x200000007:0x1:0x0].0xab43d606 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.222959:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb481c5 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894d4 expref: 12 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.222976:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45a00/0x872d29295eb481da lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x11/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894d4 expref: 11 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.222983:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f27838b1600) 00010000:00010000:3.0:1787365406.222985:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 11 00010000:00010000:3.0:1787365406.222988:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45a00, rc 0) 00000100:00100000:3.0:1787365406.223077:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808f100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+11:14452:x1874188003561984:12345-192.168.203.13@tcp:101:bash.0 Request processed in 1614us (1893us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365406.223085:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 27 00000100:00100000:0.0:1787365406.230700:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365406.230856:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003562240 00000100:00100000:3.0:1787365406.230898:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003562240 00000100:00100000:3.0:1787365406.230979:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 28 00000100:00100000:3.0:1787365406.230990:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+11:14452:x1874188003562240:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:3.0:1787365406.231017:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365406.231045:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb481e1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989894db expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.231225:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb481e8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.231244:0:14409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb481be lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894cd expref: 11 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.231254:0:14409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb481e8 lrc: 4/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.231301:0:14409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb481be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894cd expref: 11 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.231316:0:14409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb481be lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894cd expref: 11 pid: 15822 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365406.231331:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6be7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14409:1874188024524800:192.168.203.13@tcp:104: 00000100:00100000:3.0:1787365406.231460:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b690b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365406.236459:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6be7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14409:1874188024524800:192.168.203.13@tcp:104: 00010000:00010000:3.0:1787365406.236503:0:14409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb481e8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365406.243043:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365406.244521:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003562368 00000100:00100000:2.0:1787365406.244563:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003562368 00010000:00010000:2.0:1787365406.244675:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb481be lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894cd expref: 12 pid: 15822 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365406.244744:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:2.0:1787365406.244756:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+12:2361:x1874188003562368:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787365406.244778:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365406.244785:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb481be lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894cd expref: 12 pid: 15822 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.244801:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb481be lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894cd expref: 12 pid: 15822 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.244830:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb481be lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x1:0x0].0x0 bits 0x13/0x0 rrc: 6 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894cd expref: 12 pid: 15822 timeout: 623 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.244850:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f27838b1600) 00010000:00010000:2.0:1787365406.244857:0:14395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 1 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb481e8 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.244868:0:14395:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb481e8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.244878:0:14395:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb481e8 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40290000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.244916:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365406.244999:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c4380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+11:2361:x1874188003562368:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 244us (1968us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365406.245027:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00010000:00010000:3.0:1787365406.245744:0:14409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb481e8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.245757:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb481e8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.245790:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb481ef lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.245801:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb481ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.245811:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb481ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.255685:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481f6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.255712:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.255727:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481f6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365406.255741:0:14409:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787365406.255778:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb481e8 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.255785:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb481e8 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.255792:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb481e8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.255819:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365406.255824:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb481e8 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.255833:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb481e8 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.255849:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f27838b1600) 00010000:00010000:3.0:1787365406.255853:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365406.255858:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb481e8 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.255865:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb481e8 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:3.0:1787365406.255883:0:14409:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000496e9727 reply state 00000000edf49c0e transno 8589934600 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb481ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365406.255899:0:14409:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00010000:00010000:3.0:1787365406.255948:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb481e1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894db expref: 14 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.255965:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894db expref: 13 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.255973:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f2789e48e00) 00010000:00010000:3.0:1787365406.255975:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 9 00010000:00010000:3.0:1787365406.255977:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45000, rc 0) 00000100:00100000:3.0:1787365406.256081:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c7b80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+14:14452:x1874188003562240:12345-192.168.203.13@tcp:101:bash.0 Request processed in 25092us (25395us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787365406.256107:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 28 00010000:00010000:3.0:1787365406.270736:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb481ef lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.270759:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb481ef lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.270769:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb481ef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.270776:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45e00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365406.270782:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb481ef lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.270790:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb481ef lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.270812:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0xd7b8fa41 (ffff9f2789e48c00) 00010000:00010000:3.0:1787365406.270816:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365406.270821:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb481ef lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.270827:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb481ef lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0xd7b8fa41 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365406.293160:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365406.293352:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003562496 00000100:00100000:0.0:1787365406.293366:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003562496 00000100:00100000:0.0:1787365406.293448:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:0.0:1787365406.293459:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+13:14452:x1874188003562496:12345-192.168.203.13@tcp:101:bash.0 00010000:00010000:0.0:1787365406.293493:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365406.293521:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb48204 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989894e2 expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365406.293606:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4820b lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365406.293675:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4820b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365406.293689:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4820b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:0.0:1787365406.294049:0:14410:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:0.0:1787365406.294054:0:14410:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:0.0:1787365406.294081:0:14410:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4820b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x5b/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365406.294102:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4820b lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365406.294133:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb48204 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894e2 expref: 15 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365406.294157:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4820b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894e2 expref: 14 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365406.294175:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f2789e48e00) 00010000:00010000:0.0:1787365406.294179:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:0.0:1787365406.294183:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27c2044400, rc 0) 00000100:00100000:0.0:1787365406.294253:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbfb480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+14:14452:x1874188003562496:12345-192.168.203.13@tcp:101:bash.0 Request processed in 796us (1109us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365406.294261:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:0.0:1787365406.304412:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365406.304495:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003562752 00000100:00100000:3.0:1787365406.304507:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003562752 00000100:00100000:3.0:1787365406.304574:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:3.0:1787365406.304585:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+14:14452:x1874188003562752:12345-192.168.203.13@tcp:35:bash.0 00000100:00100000:3.0:1787365406.305196:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+15:14452:x1874188003562752:12345-192.168.203.13@tcp:35:bash.0 Request processed in 512us (698us total) trans 8589934601 rc 0/0 00000100:00100000:3.0:1787365406.305224:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00010000:00010000:0.0:1787365406.387294:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365406.541088:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365406.546120:0:15822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003563008 00000100:00100000:2.0:1787365406.546144:0:15822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003563008 00000100:00100000:2.0:1787365406.546255:0:15822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:2.0:1787365406.546269:0:15822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f02bb255-97c1-4c08-8e1d-6c853c05ec45+15:14462:x1874188003563008:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:2.0:1787365406.546305:0:15822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365406.546334:0:15822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb48212 lrc: 2/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989894e9 expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365406.546659:0:15822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x1:0x0]: returning size 512 00010000:00010000:2.0:1787365406.547540:0:15822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb48212 lrc: 1/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894e9 expref: 17 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.547569:0:15822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000007:0x1:0x0].0x0 (ffff9f27838b1e00) 00010000:00010000:2.0:1787365406.547573:0:15822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:2.0:1787365406.547579:0:15822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb48212 lrc: 0/0,0 mode: --/CR res: [0x200000007:0x1:0x0].0x0 bits 0x1/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894e9 expref: 17 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.547601:0:15822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cc800, rc 0) 00000100:00100000:2.0:1787365406.547768:0:15822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f02bb255-97c1-4c08-8e1d-6c853c05ec45+16:14462:x1874188003563008:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 1499us (6693us total) trans 8589934602 rc 301/301 00000100:00100000:2.0:1787365406.547778:0:15822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 30 00000100:00100000:2.0:1787365406.552377:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365406.552535:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003563264 00000100:00100000:3.0:1787365406.552549:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003563264 00000100:00100000:3.0:1787365406.552655:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:3.0:1787365406.552669:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+16:14462:x1874188003563264:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1787365406.553023:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+17:14462:x1874188003563264:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 356us (660us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787365406.553032:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:0.0:1787365406.625314:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365406.626454:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003563520 00000100:00100000:3.0:1787365406.626470:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003563520 00000100:00100000:3.0:1787365406.626558:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:3.0:1787365406.626571:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+17:14465:x1874188003563520:12345-192.168.203.13@tcp:101:lfs.0 00010000:00010000:3.0:1787365406.626604:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365406.626662:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb48220 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989894f0 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.626790:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb48227 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.626807:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb48227 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.626819:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb48227 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365406.626832:0:14408:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787365406.626999:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb48220 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894f0 expref: 20 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.627048:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb48227 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894f0 expref: 19 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.627057:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f2789e48e00) 00010000:00010000:3.0:1787365406.627061:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787365406.627065:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44400, rc 0) 00000100:00100000:3.0:1787365406.627166:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c6a00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+19:14465:x1874188003563520:12345-192.168.203.13@tcp:101:lfs.0 Request processed in 597us (1863us total) trans 8589934604 rc 0/0 00000100:00100000:3.0:1787365406.627174:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 31 00000100:00100000:0.0:1787365406.632954:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365406.633032:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365406.633255:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003563776 00000100:00100000:3.0:1787365406.633267:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003563776 00000100:00100000:3.0:1787365406.633349:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:3.0:1787365406.633361:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+19:14465:x1874188003563776:12345-192.168.203.13@tcp:54:lfs.0 00010000:00010000:3.0:1787365406.633455:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb48235 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.633477:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb48235 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.633491:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb48235 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.633524:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb48235 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.633531:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb48235 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.633560:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb48235 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.633567:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365406.633572:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb48235 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.633580:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb48235 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.633594:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f2789e48e00) 00010000:00010000:3.0:1787365406.633598:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787365406.633603:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb48235 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365406.633610:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb48235 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365406.633739:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c7100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+19:14465:x1874188003563776:12345-192.168.203.13@tcp:54:lfs.0 Request processed in 380us (706us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365406.633749:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 32 00000100:00100000:2.0:1787365406.633835:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003563648 00000100:00100000:2.0:1787365406.633840:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003563648 00000100:00100000:2.0:1787365406.633886:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:2.0:1787365406.633895:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+19:2362:x1874188003563648:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787365406.633917:0:14393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365406.633937:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb48227 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894f0 expref: 19 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365406.633950:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f2789e48e00) 00010000:00010000:2.0:1787365406.633953:0:14393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365406.633975:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c6300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+18:2362:x1874188003563648:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 82us (1036us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365406.633983:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:2.0:1787365406.637242:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365406.637393:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003564032 00000100:00100000:3.0:1787365406.637405:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003564032 00000100:00100000:3.0:1787365406.637475:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1787365406.637487:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+18:14465:x1874188003564032:12345-192.168.203.13@tcp:35:lfs.0 00000100:00100000:3.0:1787365406.637851:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808c700 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+19:14465:x1874188003564032:12345-192.168.203.13@tcp:35:lfs.0 Request processed in 365us (620us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787365406.637861:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:1.0:1787365407.222303:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365407.222401:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003564288 00000100:00100000:3.0:1787365407.222413:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003564288 00000100:00100000:3.0:1787365407.222568:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:3.0:1787365407.222583:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+19:14496:x1874188003564288:12345-192.168.203.13@tcp:101:cat.0 00010000:00010000:3.0:1787365407.222616:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365407.222688:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb4823c lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989894f7 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.222865:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb48243 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.224118:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb48243 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.224138:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb48243 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365407.224159:0:14408:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787365407.224374:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb4823c lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x1:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894f7 expref: 22 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.224397:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb48243 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894f7 expref: 21 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.224405:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f2789e48e00) 00010000:00010000:3.0:1787365407.224408:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787365407.224412:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45e00, rc 0) 00000100:00100000:3.0:1787365407.224508:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbfaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+21:14496:x1874188003564288:12345-192.168.203.13@tcp:101:cat.0 Request processed in 1929us (2217us total) trans 8589934606 rc 0/0 00000100:00100000:3.0:1787365407.224535:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:1.0:1787365407.229308:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365407.229360:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365407.229483:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003564672 00000100:00100000:2.0:1787365407.229495:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003564672 00000100:00100000:2.0:1787365407.229579:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:2.0:1787365407.229590:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+21:2359:x1874188003564672:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787365407.229611:0:14394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365407.229683:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb48243 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894f7 expref: 21 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.229716:0:14394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f2789e48e00) 00010000:00010000:2.0:1787365407.229722:0:14394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365407.229787:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbfa300 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+20:2359:x1874188003564672:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 198us (426us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365407.229797:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:3.0:1787365407.233990:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003564544 00000100:00100000:3.0:1787365407.234008:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003564544 00000100:00100000:3.0:1787365407.234078:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:3.0:1787365407.234099:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+20:14496:x1874188003564544:12345-192.168.203.13@tcp:35:cat.0 00000100:00080000:0.0:1787365407.234614:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365407.236042:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbfb800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+21:14496:x1874188003564544:12345-192.168.203.13@tcp:35:cat.0 Request processed in 1940us (6734us total) trans 8589934607 rc 0/0 00000100:00100000:3.0:1787365407.236058:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 8 00000100:00100000:1.0:1787365407.332268:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365407.332694:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003564928 00000100:00100000:3.0:1787365407.332708:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003564928 00000100:00100000:3.0:1787365407.332942:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:3.0:1787365407.332957:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+21:14502:x1874188003564928:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:3.0:1787365407.332992:0:14409:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365407.333020:0:14409:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb48251 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c989894fe expref: -99 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.333176:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb48258 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.333194:0:14409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481f6 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894db expref: 22 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.333203:0:14409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4820b lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894e2 expref: 22 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.333212:0:14409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb48258 lrc: 5/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.333274:0:14409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4820b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894e2 expref: 22 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.333290:0:14409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4820b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894e2 expref: 22 pid: 14410 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365407.333307:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6be7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14409:1874188024524928:192.168.203.13@tcp:104: 00010000:00010000:3.0:1787365407.333451:0:14409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894db expref: 22 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.333461:0:14409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481f6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x70200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894db expref: 22 pid: 14409 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365407.333471:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb409500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14409:1874188024525056:192.168.203.13@tcp:104: 00000100:00100000:3.0:1787365407.333497:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b690b3c0 going to sleep for 11 seconds 00000100:00100000:3.0:1787365407.339178:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6be7100 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14409:1874188024524928:192.168.203.13@tcp:104: 00000100:00100000:3.0:1787365407.339199:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb409500 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14409:1874188024525056:192.168.203.13@tcp:104: 00010000:00010000:3.0:1787365407.339238:0:14409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb48258 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365407.344388:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365407.344513:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003565056 00000100:00100000:3.0:1787365407.344526:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003565056 00010000:00010000:3.0:1787365407.344578:0:14395:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4820b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894e2 expref: 23 pid: 14410 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365407.344665:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:3.0:1787365407.344696:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bac91c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+23:2361:x1874188003565056:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365407.344732:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365407.344740:0:14395:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4820b lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894e2 expref: 23 pid: 14410 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.344754:0:14395:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4820b lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894e2 expref: 23 pid: 14410 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.344781:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4820b lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x1b/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894e2 expref: 23 pid: 14410 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.344801:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f2789e48e00) 00010000:00010000:3.0:1787365407.344806:0:14395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb48258 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.344824:0:14395:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 2 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb48258 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.344831:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365407.346139:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bac91c50 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+22:2361:x1874188003565056:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 1432us (1752us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365407.346152:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:1.0:1787365407.351965:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365407.352201:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003565184 00000100:00100000:3.0:1787365407.352215:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003565184 00010000:00010000:3.0:1787365407.352264:0:14393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481f6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 3 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894db expref: 22 pid: 14409 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365407.352303:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:3.0:1787365407.352326:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+22:2361:x1874188003565184:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365407.352359:0:14393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365407.352368:0:14393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481f6 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x60200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894db expref: 22 pid: 14409 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.352384:0:14393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481f6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x50200400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894db expref: 22 pid: 14409 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.352412:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb481f6 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x9/0x0 rrc: 4 type: IBT gid 0 flags: 0x44a01400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894db expref: 22 pid: 14409 timeout: 624 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.352433:0:14393:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f2789e48e00) 00010000:00010000:3.0:1787365407.352439:0:14393:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 0 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb48258 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.352450:0:14393:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb48258 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.352460:0:14393:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb48258 lrc: 4/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 3 type: IBT flags: 0x40290000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.352509:0:14393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365407.352570:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbfad80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+21:2361:x1874188003565184:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 245us (619us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365407.352579:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00010000:00010000:1.0:1787365407.353171:0:14409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb48258 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365407.353183:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb48258 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:1.0:1787365407.353206:0:14409:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:1.0:1787365407.353432:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb48251 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894fe expref: 22 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365407.353453:0:14409:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44000/0x872d29295eb48258 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x2:0x0].0x0 bits 0x5/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c989894fe expref: 21 pid: 14409 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365407.353462:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f2789e48e00) 00010000:00010000:1.0:1787365407.353466:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 5 00010000:00010000:1.0:1787365407.353470:0:14409:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44000, rc 0) 00000100:00100000:1.0:1787365407.353516:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+21:14502:x1874188003564928:12345-192.168.203.13@tcp:101:dd.0 Request processed in 20563us (21263us total) trans 8589934608 rc 0/0 00000100:00100000:1.0:1787365407.353538:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:1.0:1787365407.369297:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365407.369454:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003565440 00000100:00100000:3.0:1787365407.369466:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003565440 00000100:00100000:3.0:1787365407.369538:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 35 00000100:00100000:3.0:1787365407.369550:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+21:14502:x1874188003565440:12345-192.168.203.13@tcp:36:dd.0 00010000:00010000:3.0:1787365407.369986:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb48266 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.370008:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb48266 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.370021:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb48266 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:3.0:1787365407.370082:0:14408:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934609 00000004:00010000:3.0:1787365407.370139:0:14408:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000060cd701a reply state 000000000d1a9c89 transno 8589934610 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb48266 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365407.370150:0:14408:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787365407.370486:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf9c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+24:14502:x1874188003565440:12345-192.168.203.13@tcp:36:dd.0 Request processed in 935us (1201us total) trans 8589934610 rc 0/0 00000100:00100000:3.0:1787365407.370495:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 35 00000020:00080000:3.0:1787365407.370501:0:14408:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00000100:00100000:3.0:1787365407.380144:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00010000:00010000:1.0:1787365407.380312:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb48266 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365407.380328:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb48266 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365407.380336:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb48266 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365407.380343:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45e00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365407.380349:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb48266 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365407.380358:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb48266 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365407.380380:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f2789e48e00) 00010000:00010000:1.0:1787365407.380383:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365407.380389:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb48266 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365407.380396:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb48266 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365407.387666:0:15822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003565568 00000100:00100000:0.0:1787365407.387687:0:15822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003565568 00000100:00100000:0.0:1787365407.387804:0:15822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 36 00000100:00100000:0.0:1787365407.387824:0:15822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f02bb255-97c1-4c08-8e1d-6c853c05ec45+23:14502:x1874188003565568:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:0.0:1787365407.387857:0:15822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:0.0:1787365407.387893:0:15822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4826d lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989505 expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365407.387972:0:15822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4826d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989505 expref: 24 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365407.387990:0:15822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4826d lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989505 expref: 24 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365407.388013:0:15822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f2789e48e00) 00010000:00010000:0.0:1787365407.388017:0:15822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:0.0:1787365407.388021:0:15822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27c2044400, rc 0) 00000100:00100000:0.0:1787365407.388110:0:15822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb409500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f02bb255-97c1-4c08-8e1d-6c853c05ec45+24:14502:x1874188003565568:12345-192.168.203.13@tcp:101:dd.0 Request processed in 288us (7980us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365407.388119:0:15822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 36 00010000:00010000:2.0:1787365407.414416:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:1.0:1787365407.424599:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365407.427110:0:14395:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003565824 00000100:00100000:3.0:1787365407.427132:0:14395:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003565824 00000100:00100000:3.0:1787365407.427255:0:14395:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:3.0:1787365407.427268:0:14395:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+24:14502:x1874188003565824:12345-192.168.203.13@tcp:103:dd.0 00010000:00010000:3.0:1787365407.427290:0:14395:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365407.427326:0:14395:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4826d lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989505 expref: 24 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.427354:0:14395:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f2789e48e00) 00010000:00010000:3.0:1787365407.427360:0:14395:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365407.427463:0:14395:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf8380 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+23:14502:x1874188003565824:12345-192.168.203.13@tcp:103:dd.0 Request processed in 197us (2877us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365407.427472:0:14395:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:2.0:1787365407.439525:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365407.441675:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003565952 00000100:00100000:3.0:1787365407.441695:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003565952 00000100:00100000:3.0:1787365407.441813:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:3.0:1787365407.441826:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+23:14502:x1874188003565952:12345-192.168.203.13@tcp:58:dd.0 00010000:00010000:3.0:1787365407.441987:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb48274 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.442009:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb48274 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.442023:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb48274 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787365407.442898:0:14408:0:(llog_osd.c:211:llog_osd_read_header()) not reading header from 0-byte log 00000040:00080000:3.0:1787365407.443073:0:14408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0xa:0x7:0x0].2, 64 off8320 00000040:00080000:3.0:1787365407.443167:0:14408:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xe:0x0].1, 136 off8328 00000100:00100000:3.0:1787365407.443321:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808c380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+23:14502:x1874188003565952:12345-192.168.203.13@tcp:58:dd.0 Request processed in 1492us (3806us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365407.443333:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 37 00000100:00100000:0.0:1787365407.453428:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365407.462012:0:15822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003566080 00000100:00100000:2.0:1787365407.462055:0:15822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003566080 00000100:00100000:2.0:1787365407.462164:0:15822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 38 00000100:00100000:2.0:1787365407.462176:0:15822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f02bb255-97c1-4c08-8e1d-6c853c05ec45+23:14502:x1874188003566080:12345-192.168.203.13@tcp:101:dd.0 00010000:00010000:2.0:1787365407.462203:0:15822:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365407.462229:0:15822:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb4827b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898950c expref: -99 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.462302:0:15822:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb48274 lrc: 2/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.462315:0:15822:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb4827b lrc: 4/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898950c expref: 24 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.462351:0:15822:0:(ldlm_request.c:385:ldlm_blocking_ast_nocheck()) ### Lock still has references, will be cancelled later ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb48274 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x40210400000020 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.462367:0:15822:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb4827b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898950c expref: 24 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.462382:0:15822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f2789e48e00) 00010000:00010000:2.0:1787365407.462386:0:15822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787365407.462390:0:15822:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb4827b lrc: 3/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898950c expref: 24 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.462398:0:15822:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cc800, rc 0) 00000100:00100000:2.0:1787365407.462492:0:15822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c4380 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f02bb255-97c1-4c08-8e1d-6c853c05ec45+24:14502:x1874188003566080:12345-192.168.203.13@tcp:101:dd.0 Request processed in 318us (9079us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365407.462500:0:15822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 38 00000040:00080000:2.0:1787365407.858874:0:14442:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787365407.858883:0:14442:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787365407.858919:0:14442:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787365407.858934:0:14442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:2.0:1787365407.859058:0:14442:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f279808e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14442:1874188024525184:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:2.0:1787365407.859175:0:14442:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27878bec00 going to sleep for 11 seconds 00000100:00100000:2.0:1787365407.864957:0:14442:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f279808e300 pname:cluuid:pid:xid:nid:opc:job hsm_cdtr:lustre-MDT0000_UUID:14442:1874188024525184:192.168.203.13@tcp:107:hsm_cdtr.0 00000100:00100000:3.0:1787365407.873138:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365407.873747:0:14419:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003566208 00000100:00100000:2.0:1787365407.873756:0:14419:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003566208 00000100:00100000:2.0:1787365407.874032:0:14419:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:2.0:1787365407.874045:0:14419:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb40ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+24:14504:x1874188003566208:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 00000100:00100000:2.0:1787365407.874146:0:14419:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb40ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt_fld_0000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+24:14504:x1874188003566208:12345-192.168.203.13@tcp:900:lhsmtool_posix.0 Request processed in 104us (1017us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365407.874155:0:14419:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:0.0:1787365407.877337:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365407.877481:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003566336 00000100:00100000:3.0:1787365407.877491:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003566336 00000100:00100000:3.0:1787365407.877548:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:3.0:1787365407.877558:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b63c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+24:14504:x1874188003566336:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:3.0:1787365407.877612:0:14408:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:3.0:1787365407.877812:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b63c6300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+24:14504:x1874188003566336:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 247us (476us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365407.877828:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 39 00000100:00100000:3.0:1787365407.892360:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365407.898404:0:15822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003566464 00000100:00100000:2.0:1787365407.898418:0:15822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003566464 00000100:00100000:2.0:1787365407.898494:0:15822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:2.0:1787365407.898504:0:15822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f02bb255-97c1-4c08-8e1d-6c853c05ec45+24:14504:x1874188003566464:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 00010000:00010000:2.0:1787365407.898577:0:15822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb48282 lrc: 3/1,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.898593:0:15822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb48282 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.898606:0:15822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb48282 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.898667:0:15822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb48289 lrc: 3/1,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.898700:0:15822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb48289 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.898708:0:15822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb48289 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899125:0:15822:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb48290 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899135:0:15822:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb48290 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899143:0:15822:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb48290 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:2.0:1787365407.899229:0:15822:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00000004:00200000:2.0:1787365407.899234:0:15822:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:2.0:1787365407.899246:0:15822:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb48290 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899256:0:15822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb48282 lrc: 3/1,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899262:0:15822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb48282 lrc: 2/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899269:0:15822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb48282 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899275:0:15822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cd400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365407.899279:0:15822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb48282 lrc: 3/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899293:0:15822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb48282 lrc: 4/0,0 mode: CR/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899306:0:15822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f27838b1200) 00010000:00010000:2.0:1787365407.899310:0:15822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365407.899314:0:15822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb48282 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899320:0:15822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb48282 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899335:0:15822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb48289 lrc: 3/1,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899341:0:15822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb48289 lrc: 2/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899347:0:15822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb48289 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899352:0:15822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cca00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365407.899355:0:15822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb48289 lrc: 3/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899360:0:15822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb48289 lrc: 4/0,0 mode: PR/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899367:0:15822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x4549062c (ffff9f27838b1100) 00010000:00010000:2.0:1787365407.899369:0:15822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365407.899371:0:15822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb48289 lrc: 2/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899386:0:15822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb48289 lrc: 0/0,0 mode: --/PR res: [0x200000002:0x2:0x0].0x4549062c bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899402:0:15822:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb48290 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899408:0:15822:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb48290 lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899414:0:15822:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb48290 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899419:0:15822:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cd200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365407.899422:0:15822:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb48290 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899428:0:15822:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb48290 lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899435:0:15822:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f2789e48e00) 00010000:00010000:2.0:1787365407.899437:0:15822:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:2.0:1787365407.899440:0:15822:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb48290 lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.899446:0:15822:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb48290 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 15822 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365407.899520:0:15822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be7480 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f02bb255-97c1-4c08-8e1d-6c853c05ec45+24:14504:x1874188003566464:12345-192.168.203.13@tcp:34:lhsmtool_posix.0 Request processed in 1016us (7168us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365407.899529:0:15822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 40 00000100:00100000:0.0:1787365407.904360:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365407.907371:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003566720 00000100:00100000:3.0:1787365407.907388:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003566720 00000100:00100000:3.0:1787365407.907458:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:3.0:1787365407.907469:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27baf91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+24:14504:x1874188003566720:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787365407.907488:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365407.907507:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb48297 lrc: 2/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989513 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.907603:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb4829e lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.907618:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb4829e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.907664:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb4829e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365407.907676:0:14408:0:(mdt_handler.c:909:mdt_pack_attr2body()) [0x200000bd1:0x2:0x0]: returning size 0 00010000:00010000:3.0:1787365407.908034:0:14408:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb4829e lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.908044:0:14408:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb4829e lrc: 2/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.908052:0:14408:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb4829e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.908058:0:14408:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45e00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365407.908074:0:14408:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb4829e lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.908092:0:14408:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb4829e lrc: 4/0,0 mode: PR/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.908105:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f2789e48e00) 00010000:00010000:3.0:1787365407.908109:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787365407.908113:0:14408:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb4829e lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.908121:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb4829e lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x2:0x0].0x0 bits 0x12/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.909009:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=301, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb48297 lrc: 1/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989513 expref: 26 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.909024:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000002:0x2:0x0].0x0 (ffff9f27838b1200) 00010000:00010000:3.0:1787365407.909027:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1 00010000:00010000:3.0:1787365407.909032:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb48297 lrc: 0/0,0 mode: --/CR res: [0x200000002:0x2:0x0].0x0 bits 0x1/0x0 rrc: 3 type: IBT gid 0 flags: 0x44801000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989513 expref: 26 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.909045:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f44400, rc 0) 00000100:00100000:3.0:1787365407.909118:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27baf91180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+25:14504:x1874188003566720:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1650us (4766us total) trans 8589934611 rc 301/301 00000100:00100000:3.0:1787365407.909126:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 41 00000100:00100000:0.0:1787365407.921521:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365407.921617:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003566848 00000100:00100000:1.0:1787365407.921657:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003566848 00000100:00100000:1.0:1787365407.921722:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:1.0:1787365407.921732:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+25:14504:x1874188003566848:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 00000004:00000080:1.0:1787365407.921779:0:14409:0:(mdt_handler.c:7972:mdt_fid2path()) path get [0x200000bd1:0x2:0x0] from 18446744073709551615 #0 00000100:00100000:1.0:1787365407.921887:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad9880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+25:14504:x1874188003566848:12345-192.168.203.13@tcp:53:lhsmtool_posix.0 Request processed in 156us (375us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365407.921896:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 42 00000100:00100000:0.0:1787365407.931510:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365407.931684:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003567104 00000100:00100000:2.0:1787365407.931693:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003567104 00000100:00100000:3.0:1787365407.932022:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:3.0:1787365407.932033:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+25:14504:x1874188003567104:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787365407.932052:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365407.932096:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb482ac lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898951a expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000004:00080000:3.0:1787365407.932650:0:14410:0:(osp_internal.h:553:osp_update_last_fid()) Gap in objids: start=[0x280000400:0x7:0x0], count =27 00000004:00080000:3.0:1787365407.932656:0:14410:0:(osp_object.c:1645:osp_create()) Writing gap [0x280000400:0x7:0x0]+27 in llog 00000004:00080000:3.0:1787365407.932700:0:14410:0:(osp_object.c:1662:osp_create()) lustre-OST0001-osc-MDT0000: Wrote last used FID: [0x280000400:0x22:0x0], index 1: 0 00010000:00010000:3.0:1787365407.933257:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb482b3 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.933273:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb482b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.933284:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb482b3 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.933342:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f44400/0x872d29295eb482ac lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898951a expref: 28 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.933360:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb482b3 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898951a expref: 27 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.933368:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f2789e48c00) 00010000:00010000:3.0:1787365407.933370:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1b 00010000:00010000:3.0:1787365407.933373:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2788f45e00, rc 0) 00000100:00100000:3.0:1787365407.933492:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbad8700 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+27:14504:x1874188003567104:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1460us (1988us total) trans 8589934612 rc 0/0 00000100:00100000:3.0:1787365407.933500:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 43 00000100:00100000:0.0:1787365407.939672:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365407.939763:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003567360 00000100:00100000:3.0:1787365407.939772:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003567360 00000100:00100000:3.0:1787365407.939834:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:3.0:1787365407.939854:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+27:14504:x1874188003567360:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787365407.939911:0:14409:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365407.939949:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45e00/0x872d29295eb482b3 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1b/0x0 rrc: 3 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898951a expref: 27 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.939969:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f2789e48c00) 00010000:00010000:3.0:1787365407.939979:0:14409:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:3.0:1787365407.940001:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb482c1 lrc: 3/0,1 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.940014:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb482c1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.940024:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb482c1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.940039:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb482c8 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x1:0x0].0x520bc129 bits 0x0/0x0 rrc: 2 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.940045:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb482c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x520bc129 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.940052:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb482c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x520bc129 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.940133:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(CW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb482c1 lrc: 3/0,1 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.940140:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb482c1 lrc: 2/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.940157:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb482c1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.940163:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45200 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365407.940166:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb482c1 lrc: 3/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.940174:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb482c1 lrc: 4/0,0 mode: CW/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.940182:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x0 (ffff9f27838b1600) 00010000:00010000:3.0:1787365407.940185:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365407.940190:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb482c1 lrc: 2/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.940196:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45200/0x872d29295eb482c1 lrc: 0/0,0 mode: --/CW res: [0x200000bd1:0x1:0x0].0x0 bits 0x2/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.940205:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb482c8 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x520bc129 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.940211:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb482c8 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x520bc129 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.940216:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb482c8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x520bc129 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.940221:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030e00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365407.940224:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb482c8 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x520bc129 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.940240:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb482c8 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x1:0x0].0x520bc129 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.940248:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x1:0x0].0x520bc129 (ffff9f2789e48f00) 00010000:00010000:3.0:1787365407.940251:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:3.0:1787365407.940254:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb482c8 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x520bc129 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.940260:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb482c8 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x1:0x0].0x520bc129 bits 0x2/0x0 rrc: 2 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365407.940326:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbadaa00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+26:14504:x1874188003567360:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 473us (662us total) trans 0 rc -2/-2 00000100:00100000:3.0:1787365407.940333:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 44 00000100:00100000:0.0:1787365407.943532:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365407.943613:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003567488 00000100:00100000:2.0:1787365407.943654:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003567488 00000100:00100000:2.0:1787365407.943703:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:2.0:1787365407.943721:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+26:14504:x1874188003567488:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365407.943740:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365407.943762:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb482cf lrc: 2/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 2 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989521 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.943796:0:14408:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb482d6 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.943818:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb482d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.943829:0:14408:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb482d6 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.943925:0:14408:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb482cf lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 3 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989521 expref: 28 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.943953:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cca00/0x872d29295eb482d6 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x20/0x0 rrc: 2 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989521 expref: 27 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.943962:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f27838b1100) 00010000:00010000:2.0:1787365407.943964:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:2.0:1787365407.943967:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cca00, rc 0) 00000100:00100000:2.0:1787365407.944013:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbada300 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+27:14504:x1874188003567488:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 302us (488us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365407.944028:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 45 00000100:00100000:0.0:1787365407.948079:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365407.948366:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003567744 00000100:00100000:3.0:1787365407.948375:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003567744 00000100:00100000:3.0:1787365407.948432:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:3.0:1787365407.948443:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+27:14504:x1874188003567744:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:3.0:1787365407.948538:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030400/0x872d29295eb482dd lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.948553:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030400/0x872d29295eb482dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.948563:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030400/0x872d29295eb482dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000040:00080000:3.0:1787365407.948917:0:14409:0:(llog_osd.c:725:llog_osd_write_rec()) added record [0x1:0xc:0x0].2, 88 off8344 00000004:00080000:3.0:1787365407.949321:0:14409:0:(osp_sync.c:1847:osp_sync_add_commit_cb()) lustre-OST0001-osc-MDT0000: add commit cb at 525113694473ns, next at 526113690969ns, rc = 0 00000004:00010000:3.0:1787365407.949479:0:14409:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 0000000024102625 reply state 00000000a03e01bb transno 8589934613 ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030400/0x872d29295eb482dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365407.949488:0:14409:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:3.0:1787365407.949620:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798098000 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+29:14504:x1874188003567744:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 1178us (1549us total) trans 8589934613 rc 0/0 00000100:00100000:3.0:1787365407.949660:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 46 00000100:00100000:0.0:1787365407.957276:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00010000:00010000:3.0:1787365407.959569:0:3297:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030400/0x872d29295eb482dd lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.959596:0:3297:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030400/0x872d29295eb482dd lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.959605:0:3297:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030400/0x872d29295eb482dd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.959612:0:3297:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:3.0:1787365407.959616:0:3297:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030400/0x872d29295eb482dd lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.959662:0:3297:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030400/0x872d29295eb482dd lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.959680:0:3297:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f27838b1100) 00010000:00010000:3.0:1787365407.959683:0:3297:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 12 00010000:00010000:3.0:1787365407.959688:0:3297:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030400/0x872d29295eb482dd lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365407.959694:0:3297:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030400/0x872d29295eb482dd lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x12/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365407.962803:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003567872 00000100:00100000:2.0:1787365407.962817:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003567872 00000100:00100000:2.0:1787365407.963370:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:2.0:1787365407.963382:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+28:14504:x1874188003567872:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:2.0:1787365407.963406:0:14408:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:2.0:1787365407.963425:0:14408:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb482e4 lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989528 expref: -99 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.963525:0:14408:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb482e4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989528 expref: 29 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.963539:0:14408:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb482e4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989528 expref: 29 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365407.963561:0:14408:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f27838b1100) 00010000:00010000:2.0:1787365407.963564:0:14408:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787365407.963567:0:14408:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f27a12cd200, rc 0) 00000100:00100000:2.0:1787365407.963732:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798099500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+29:14504:x1874188003567872:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 331us (6443us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365407.963740:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 47 00000100:00100000:3.0:1787365407.971428:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365407.971574:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003568000 00000100:00100000:2.0:1787365407.971584:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003568000 00000100:00100000:2.0:1787365407.971670:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:2.0:1787365407.971680:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+5:2362:x1874188003568000:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00000100:00080000:0.0:1787365407.972199:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787365407.972774:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be5180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+6:2362:x1874188003568000:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 1092us (1352us total) trans 8589934594 rc 0/0 00000100:00100000:2.0:1787365407.972957:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 12 00000100:00100000:2.0:1787365407.984025:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365407.984127:0:14411:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003568256 00000100:00100000:1.0:1787365407.984136:0:14411:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003568256 00000100:00100000:1.0:1787365407.984208:0:14411:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1787365407.984218:0:14411:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f279808e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+29:14504:x1874188003568256:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000100:00100000:1.0:1787365407.985052:0:14411:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f279808e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+30:14504:x1874188003568256:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 832us (1033us total) trans 8589934614 rc 0/0 00000100:00100000:1.0:1787365407.985062:0:14411:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 9 00000100:00100000:1.0:1787365407.995831:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365407.997687:0:15822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003568512 00000100:00100000:0.0:1787365407.997700:0:15822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003568512 00000100:00100000:0.0:1787365407.997776:0:15822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:0.0:1787365407.997788:0:15822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f02bb255-97c1-4c08-8e1d-6c853c05ec45+30:14504:x1874188003568512:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787365407.997904:0:15822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf8a80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f02bb255-97c1-4c08-8e1d-6c853c05ec45+30:14504:x1874188003568512:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 117us (2081us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365407.997911:0:15822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 48 00000100:00100000:0.0:1787365408.004313:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365408.004401:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003568640 00000100:00100000:3.0:1787365408.004409:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003568640 00000100:00100000:3.0:1787365408.004468:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:3.0:1787365408.004477:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+30:14504:x1874188003568640:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:3.0:1787365408.004498:0:14410:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:3.0:1787365408.004532:0:14410:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030400/0x872d29295eb482eb lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898952f expref: -99 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.004604:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb482f2 lrc: 3/1,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.004618:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb482f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.004670:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb482f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00200000:3.0:1787365408.005527:0:14410:0:(mdt_handler.c:1574:mdt_getattr_internal()) dirent count 0 stripe count 1 MDT count 1 00000004:00010000:3.0:1787365408.005550:0:14410:0:(mdt_handler.c:2507:mdt_getattr_name_lock()) ### Returning lock to client ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb482f2 lrc: 3/1,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.005583:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030400/0x872d29295eb482eb lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT gid 0 flags: 0x44000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898952f expref: 32 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.005601:0:14410:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb482f2 lrc: 3/0,0 mode: PR/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 4 type: IBT gid 0 flags: 0x40200000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898952f expref: 31 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.005610:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f27838b1100) 00010000:00010000:3.0:1787365408.005613:0:14410:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 1a 00010000:00010000:3.0:1787365408.005616:0:14410:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2780030e00, rc 0) 00000100:00100000:3.0:1787365408.005996:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798099880 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+31:14504:x1874188003568640:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 1519us (1690us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365408.006004:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 49 00000100:00100000:2.0:1787365408.012481:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365408.012570:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003568768 00000100:00100000:0.0:1787365408.012583:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003568768 00000100:00100000:0.0:1787365408.012668:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:0.0:1787365408.012687:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+6:2362:x1874188003568768:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:0.0:1787365408.012704:0:15094:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365408.015318:0:15094:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000001ebcca37/0x872d29295eb482f9 lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c98989536 expref: -99 pid: 15094 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00002000:00010000:1.0:1787365408.015354:0:15094:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x0, atime: 0x0, ctime: 0x6a89081f, blocks: 0x1 00010000:00010000:1.0:1787365408.015380:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=525s v=(0 0) 00010000:00010000:1.0:1787365408.015385:0:15094:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365408.015397:0:15094:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000001ebcca37/0x872d29295eb482f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989536 expref: 7 pid: 15094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.015428:0:15094:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 000000001ebcca37/0x872d29295eb482f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989536 expref: 7 pid: 15094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.015443:0:15094:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115e00, rc 0) 00000100:00100000:1.0:1787365408.015529:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b56300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+7:2362:x1874188003568768:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 2851us (3054us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365408.015538:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:1.0:1787365408.030597:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365408.031247:0:15822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003569024 00000100:00100000:0.0:1787365408.031256:0:15822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003569024 00000100:00100000:0.0:1787365408.031316:0:15822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:0.0:1787365408.031326:0:15822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f02bb255-97c1-4c08-8e1d-6c853c05ec45+31:14504:x1874188003569024:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00000100:00100000:0.0:1787365408.031479:0:15822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbfb100 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:f02bb255-97c1-4c08-8e1d-6c853c05ec45+31:14504:x1874188003569024:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 153us (901us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365408.031488:0:15822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 50 00000100:00100000:0.0:1787365408.048377:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365408.048745:0:14408:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003569152 00000100:00100000:2.0:1787365408.048754:0:14408:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003569152 00000100:00100000:2.0:1787365408.048819:0:14408:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:2.0:1787365408.048830:0:14408:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+31:14504:x1874188003569152:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 00000100:00100000:0.0:1787365408.138884:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365408.138921:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365408.138954:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365408.138976:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365408.139009:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365408.139034:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003569408 00000100:00100000:0.0:1787365408.139042:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003569408 00000100:00100000:0.0:1787365408.139092:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003569664 00000100:00100000:0.0:1787365408.139095:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003569664 00000100:00100000:0.0:1787365408.139108:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003569792 00000100:00100000:0.0:1787365408.139110:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003569792 00000100:00100000:0.0:1787365408.139124:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1787365408.139132:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2798099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+5:2359:x1874188003569408:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365408.139192:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798099180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+5:2359:x1874188003569408:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 60us (325us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365408.139198:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1787365408.139212:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:0.0:1787365408.139218:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+5:2359:x1874188003569664:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365408.139236:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8d500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+5:2359:x1874188003569664:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 18us (315us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365408.139241:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:0.0:1787365408.139250:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:0.0:1787365408.139255:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+5:2359:x1874188003569792:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365408.139287:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8ce00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+5:2359:x1874188003569792:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 32us (277us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365408.139293:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:0.0:1787365408.139308:0:14402:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003569280 00000100:00100000:0.0:1787365408.139311:0:14402:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003569280 00000100:00100000:0.0:1787365408.139332:0:14402:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:0.0:1787365408.139337:0:14402:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+13:2359:x1874188003569280:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365408.139363:0:14402:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65ae050 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0001:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+13:2359:x1874188003569280:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (410us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365408.139369:0:14402:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 123 00000100:00100000:0.0:1787365408.139393:0:15822:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003569536 00000100:00100000:0.0:1787365408.139396:0:15822:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003569536 00000100:00100000:0.0:1787365408.139420:0:15822:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00100000:0.0:1787365408.139426:0:15822:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+11:2359:x1874188003569536:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:0.0:1787365408.139451:0:15822:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8ea00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_003:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+11:2359:x1874188003569536:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 26us (474us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365408.139457:0:15822:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 29 00000100:00080000:0.0:1787365408.139472:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00080000:0.0:1787365408.139476:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:0.0:1787365408.139478:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000001:00080000:3.0:1787365408.146396:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934597 is committed 00000001:00080000:3.0:1787365408.146415:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934614 is committed 00000004:00080000:3.0:1787365408.146433:0:5855:0:(osp_sync.c:1812:osp_sync_local_commit_cb()) lustre-OST0001-osc-MDT0000: 2 committed 00000001:00080000:3.0:1787365408.146470:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934599 is committed 00000100:00100000:0.0:1787365408.147021:0:14408:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2798099c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+14:14504:x1874188003569152:12345-192.168.203.13@tcp:44:lhsmtool_posix.0 Request processed in 98190us (98648us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365408.147032:0:14408:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 51 00000100:00100000:3.0:1787365408.148342:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27b6be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024525312:0@lo:2:osp-syn-1-0.0 00000100:00100000:3.0:1787365408.148401:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365408.149393:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024525312 00000100:00100000:0.0:1787365408.149403:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024525312 00000100:00100000:0.0:1787365408.149465:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787365408.149474:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b6be7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024525312:12345-0@lo:2:osp-syn-1-0.0 00000100:00080000:1.0:1787365408.150789:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00002000:00010000:0.0:1787365408.151115:0:15093:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787365408.151119:0:15093:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 0 00002000:00010000:0.0:1787365408.151122:0:15093:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 0 00002000:00010000:0.0:1787365408.151124:0:15093:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787365407 -> 1787365407 00002000:00010000:0.0:1787365408.151126:0:15093:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787365408.151621:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b6be7100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:lustre-MDT0000-mdtlov_UUID+6:3312:x1874188024525312:12345-0@lo:2:osp-syn-1-0.0 Request processed in 2145us (3217us total) trans 8589934595 rc 0/0 00000100:00100000:0.0:1787365408.151663:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000004:00080000:3.0:1787365408.152020:0:3312:0:(osp_sync.c:622:osp_sync_interpret()) reply req ffff9f27b6be5500/2, rc 0, transno 8589934595 00000100:00100000:3.0:1787365408.152027:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27b6be5500 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024525312:0@lo:2:osp-syn-1-0.0 00000100:00100000:0.0:1787365408.153760:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365408.153833:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003569920 00000100:00100000:3.0:1787365408.153841:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003569920 00000100:00100000:3.0:1787365408.154833:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:3.0:1787365408.154845:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+7:2362:x1874188003569920:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 00000100:00100000:3.0:1787365408.154967:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8ed80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+7:2362:x1874188003569920:12345-192.168.203.13@tcp:16:lhsmtool_posix.0 Request processed in 125us (1212us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365408.154974:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:0.0:1787365408.165466:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365408.167313:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003570176 00000100:00100000:3.0:1787365408.167324:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003570176 00000100:00100000:2.0:1787365408.170991:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 52 00000100:00100000:2.0:1787365408.171005:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+14:14504:x1874188003570176:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 00010000:00010000:2.0:1787365408.171055:0:14410:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365408.171080:0:14410:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2780030e00/0x872d29295eb482f2 lrc: 0/0,0 mode: --/PR res: [0x200000bd1:0x3:0x0].0x0 bits 0x1a/0x0 rrc: 5 type: IBT gid 0 flags: 0x44a01000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898952f expref: 14 pid: 14410 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.171110:0:14410:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f27838b1100) 00010000:00010000:2.0:1787365408.171114:0:14410:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00010000:00010000:2.0:1787365408.171142:0:14410:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48300 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.171155:0:14410:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48300 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.171165:0:14410:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48300 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000004:00010000:2.0:1787365408.171333:0:14410:0:(mdt_handler.c:4489:mdt_save_lock()) ### save lock request 00000000e1eadc8a reply state 00000000ac96145f transno 8589934615 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48300 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365408.171358:0:14410:0:(service.c:179:ptlrpc_save_lock()) nlocks 0 00000100:00100000:2.0:1787365408.171455:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8ca80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+15:14504:x1874188003570176:12345-192.168.203.13@tcp:36:lhsmtool_posix.0 Request processed in 453us (5998us total) trans 8589934615 rc 0/0 00000100:00100000:2.0:1787365408.171463:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 52 00010000:00010000:1.0:1787365408.186645:0:3296:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(TXN) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48300 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.186663:0:3296:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48300 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.186672:0:3296:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48300 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.186677:0:3296:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cce00 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:1.0:1787365408.186682:0:3296:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48300 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.186690:0:3296:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48300 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.186706:0:3296:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f27838b1100) 00010000:00010000:1.0:1787365408.186709:0:3296:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:1.0:1787365408.186713:0:3296:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48300 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.186720:0:3296:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cce00/0x872d29295eb48300 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x2/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14410 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365408.186795:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365408.186855:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003570304 00000100:00100000:1.0:1787365408.186871:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003570304 00000100:00100000:1.0:1787365408.186914:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:1.0:1787365408.186932:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+7:14504:x1874188003570304:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 00010000:00010000:1.0:1787365408.186950:0:15093:0:(ldlm_lockd.c:1265:ldlm_handle_enqueue()) ### server-side enqueue handler START 00010000:00010000:1.0:1787365408.186965:0:15093:0:(ldlm_lockd.c:1343:ldlm_handle_enqueue()) ### server-side enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000dbc0253f/0x872d29295eb48307 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x42e1ef2c9898953d expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.186991:0:15093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 000000001ebcca37/0x872d29295eb482f9 lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989536 expref: 8 pid: 15094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.187000:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365408.187004:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365408.187009:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbc0253f/0x872d29295eb48307 lrc: 4/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898953d expref: 8 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.187040:0:15093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 000000001ebcca37/0x872d29295eb482f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989536 expref: 8 pid: 15094 timeout: 0 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.187053:0:15093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 000000001ebcca37/0x872d29295eb482f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989536 expref: 8 pid: 15094 timeout: 625 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365408.187068:0:15093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15093:1874188024525440:192.168.203.13@tcp:104: 00000100:00100000:1.0:1787365408.187153:0:15093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2784ef1840 going to sleep for 11 seconds 00000100:00100000:1.0:1787365408.209778:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365408.210096:0:15093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbfa680 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15093:1874188024525440:192.168.203.13@tcp:104: 00010000:00010000:3.0:1787365408.210128:0:15093:0:(ldlm_lockd.c:1513:ldlm_handle_enqueue()) ### server-side enqueue handler, sending reply (err=0, rc=0) ns: filter-lustre-OST0001_UUID lock: 00000000dbc0253f/0x872d29295eb48307 lrc: 3/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898953d expref: 8 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.210148:0:15093:0:(ldlm_lockd.c:1592:ldlm_handle_enqueue()) ### server-side enqueue handler END (lock ffff9f2798115a00, rc 0) 00000100:00100000:3.0:1787365408.210202:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b57b80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+8:14504:x1874188003570304:12345-192.168.203.13@tcp:101:lhsmtool_posix.0 Request processed in 23270us (23411us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365408.210222:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 16 00000100:00100000:0.0:1787365408.210487:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003570432 00000100:00100000:0.0:1787365408.210493:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003570432 00010000:00010000:0.0:1787365408.210534:0:14394:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 000000001ebcca37/0x872d29295eb482f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989536 expref: 8 pid: 15094 timeout: 625 lvb_type: 1 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365408.210560:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:0.0:1787365408.210568:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+8:2361:x1874188003570432:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:0.0:1787365408.210581:0:14394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:0.0:1787365408.210600:0:14394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 000000001ebcca37/0x872d29295eb482f9 lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989536 expref: 8 pid: 15094 timeout: 625 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.210614:0:14394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 000000001ebcca37/0x872d29295eb482f9 lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989536 expref: 8 pid: 15094 timeout: 625 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.210670:0:14394:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000001ebcca37/0x872d29295eb482f9 lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989536 expref: 8 pid: 15094 timeout: 625 lvb_type: 1 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.210683:0:14394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365408.210687:0:14394:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:0.0:1787365408.210694:0:14394:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 00000000dbc0253f/0x872d29295eb48307 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898953d expref: 7 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.210715:0:14394:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000dbc0253f/0x872d29295eb48307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40080000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898953d expref: 7 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.210744:0:14394:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: filter-lustre-OST0001_UUID lock: 00000000dbc0253f/0x872d29295eb48307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898953d expref: 7 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365408.210758:0:14394:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2788f8c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14394:1874188024525568:192.168.203.13@tcp:105: 00000100:00100000:0.0:1787365408.213009:0:14394:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473f480 going to sleep for 11 seconds 00000100:00100000:0.0:1787365408.217889:0:14394:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2788f8c700 pname:cluuid:pid:xid:nid:opc:job ldlm_cn00_001:lustre-OST0001_UUID:14394:1874188024525568:192.168.203.13@tcp:105: 00010000:00010000:0.0:1787365408.217915:0:14394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:0.0:1787365408.217965:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf8e00 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+7:2361:x1874188003570432:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 7396us (8194us total) trans 0 rc 0/0 00000100:00100000:0.0:1787365408.217977:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 13 00000100:00100000:1.0:1787365408.218557:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365408.218662:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003570560 00000100:00100000:0.0:1787365408.218669:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003570560 00000100:00100000:0.0:1787365408.218710:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:0.0:1787365408.218718:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+7:2361:x1874188003570560:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 00002000:00010000:0.0:1787365408.218994:0:15094:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 0 00002000:00010000:0.0:1787365408.218998:0:15094:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 0 -> 1787365406 00002000:00010000:0.0:1787365408.219001:0:15094:0:(ofd_lvb.c:319:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb atime from disk: 0 -> 1787365405 00002000:00010000:0.0:1787365408.219004:0:15094:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787365407 -> 1787365406 00002000:00010000:0.0:1787365408.219006:0:15094:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 1 00000100:00100000:0.0:1787365408.219981:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf9f80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+8:2361:x1874188003570560:12345-192.168.203.13@tcp:2:lhsmtool_posix.0 Request processed in 1259us (1421us total) trans 8589934596 rc 0/0 00000100:00100000:0.0:1787365408.220006:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 17 00000100:00100000:2.0:1787365408.227599:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365408.227712:0:15093:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003570688 00000100:00100000:3.0:1787365408.227722:0:15093:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003570688 00000100:00100000:3.0:1787365408.227767:0:15093:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:3.0:1787365408.227775:0:15093:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+8:2362:x1874188003570688:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 00010000:00010000:3.0:1787365408.227824:0:15093:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a88e3a/0x872d29295eb4830e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.227844:0:15093:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: filter-lustre-OST0001_UUID lock: 00000000dbc0253f/0x872d29295eb48307 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40000000020000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898953d expref: 8 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.227853:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 1 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365408.227857:0:15093:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:3.0:1787365408.227862:0:15093:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a88e3a/0x872d29295eb4830e lrc: 4/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.227900:0:15093:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: filter-lustre-OST0001_UUID lock: 00000000dbc0253f/0x872d29295eb48307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000000020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898953d expref: 8 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.227914:0:15093:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: filter-lustre-OST0001_UUID lock: 00000000dbc0253f/0x872d29295eb48307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x70000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898953d expref: 8 pid: 15093 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365408.227928:0:15093:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb55b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15093:1874188024525696:192.168.203.13@tcp:104: 00000100:00100000:3.0:1787365408.227990:0:15093:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f2685de3a80 going to sleep for 11 seconds 00000100:00100000:1.0:1787365408.251040:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365408.251195:0:15093:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb55b100 pname:cluuid:pid:xid:nid:opc:job ll_ost00_001:lustre-OST0001_UUID:15093:1874188024525696:192.168.203.13@tcp:104: 00010000:00010000:3.0:1787365408.251240:0:15093:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: filter-lustre-OST0001_UUID lock: 0000000060a88e3a/0x872d29295eb4830e lrc: 3/1,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365408.251449:0:14393:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003570816 00000100:00100000:2.0:1787365408.251456:0:14393:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003570816 00010000:00010000:2.0:1787365408.251493:0:14393:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: filter-lustre-OST0001_UUID lock: 00000000dbc0253f/0x872d29295eb48307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898953d expref: 9 pid: 15093 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365408.251532:0:14393:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 14 00000100:00100000:2.0:1787365408.251542:0:14393:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+9:2361:x1874188003570816:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:2.0:1787365408.251556:0:14393:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:2.0:1787365408.251579:0:14393:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: filter-lustre-OST0001_UUID lock: 00000000dbc0253f/0x872d29295eb48307 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x60000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898953d expref: 9 pid: 15093 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.251591:0:14393:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: filter-lustre-OST0001_UUID lock: 00000000dbc0253f/0x872d29295eb48307 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50000400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898953d expref: 9 pid: 15093 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.251616:0:14393:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000dbc0253f/0x872d29295eb48307 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44801400020020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898953d expref: 9 pid: 15093 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.251996:0:14393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787365408.252002:0:14393:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(1 0) 00010000:00010000:2.0:1787365408.252015:0:14393:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: filter-lustre-OST0001_UUID lock: 0000000060a88e3a/0x872d29295eb4830e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.253285:0:14393:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000060a88e3a/0x872d29295eb4830e lrc: 4/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40090000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.253443:0:14393:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:2.0:1787365408.253506:0:14393:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf8000 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+8:2361:x1874188003570816:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 1962us (2473us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365408.253515:0:14393:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 14 00010000:00010000:1.0:1787365408.257802:0:15093:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: filter-lustre-OST0001_UUID lock: 0000000060a88e3a/0x872d29295eb4830e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.257843:0:15093:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000060a88e3a/0x872d29295eb4830e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.257880:0:15093:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PR) ns: filter-lustre-OST0001_UUID lock: 0000000060a88e3a/0x872d29295eb4830e lrc: 3/1,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.258850:0:15093:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000060a88e3a/0x872d29295eb4830e lrc: 2/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.258859:0:15093:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000060a88e3a/0x872d29295eb4830e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.258867:0:15093:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030400 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365408.258871:0:15093:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a88e3a/0x872d29295eb4830e lrc: 3/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.260870:0:15093:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000060a88e3a/0x872d29295eb4830e lrc: 4/0,0 mode: PR/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.260996:0:15093:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000060a88e3a/0x872d29295eb4830e lrc: 2/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.261005:0:15093:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000060a88e3a/0x872d29295eb4830e lrc: 0/0,0 mode: --/PR res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->18446744073709551615] (req 0->18446744073709551615) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15093 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365408.263985:0:15093:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b55880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+7:2362:x1874188003570688:12345-192.168.203.13@tcp:1:lhsmtool_posix.0 Request processed in 36198us (36382us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365408.264000:0:15093:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 18 00000100:00100000:1.0:1787365408.270618:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365408.274808:0:14409:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003571072 00000100:00100000:0.0:1787365408.274821:0:14409:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003571072 00000100:00100000:0.0:1787365408.275033:0:14409:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 53 00000100:00100000:0.0:1787365408.275044:0:14409:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+14:14504:x1874188003571072:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 00010000:00010000:0.0:1787365408.275133:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb48315 lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.275151:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb48315 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.275163:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb48315 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.275394:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4831c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 4 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.275406:0:14409:0:(ldlm_lock.c:687:ldlm_add_bl_work_item()) ### lock incompatible; sending blocking AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb482e4 lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989528 expref: 15 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.275415:0:14409:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4831c lrc: 4/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.275462:0:14409:0:(ldlm_lockd.c:963:ldlm_server_blocking_ast()) ### server preparing blocking AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb482e4 lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x50000000000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989528 expref: 15 pid: 14408 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.275476:0:14409:0:(ldlm_lockd.c:495:ldlm_add_waiting_lock()) ### adding to wait list(timeout: 100, AT: on) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb482e4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x70000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989528 expref: 15 pid: 14408 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365408.275503:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2788f8c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14409:1874188024525824:192.168.203.13@tcp:104: 00000100:00100000:0.0:1787365408.275594:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473f480 going to sleep for 11 seconds 00000100:00100000:1.0:1787365408.281709:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365408.281904:0:14394:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003571200 00000100:00100000:3.0:1787365408.281913:0:14394:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003571200 00010000:00010000:3.0:1787365408.281953:0:14394:0:(ldlm_lockd.c:2683:ldlm_cancel_hpreq_check()) ### hpreq cancel/convert lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb482e4 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989528 expref: 16 pid: 14408 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365408.281995:0:14394:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 15 00000100:00100000:3.0:1787365408.282005:0:14394:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+16:2361:x1874188003571200:12345-192.168.203.13@tcp:103:ldlm_bl.0 00010000:00010000:3.0:1787365408.282020:0:14394:0:(ldlm_lockd.c:1747:ldlm_request_cancel()) ### server-side cancel handler START: 1 locks, starting at 0 00010000:00010000:3.0:1787365408.282026:0:14394:0:(ldlm_lockd.c:1796:ldlm_request_cancel()) ### server cancels blocked lock after 0s ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb482e4 lrc: 5/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x60000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989528 expref: 16 pid: 14408 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.282038:0:14394:0:(ldlm_lockd.c:568:ldlm_del_waiting_lock()) ### removed ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb482e4 lrc: 4/0,0 mode: CR/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x50000400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989528 expref: 16 pid: 14408 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.282059:0:14394:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f27838b1100) 00010000:00010000:3.0:1787365408.282064:0:14394:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4831c lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.282074:0:14394:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4831c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.282090:0:14394:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4831c lrc: 4/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50290000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.282108:0:14394:0:(ldlm_lockd.c:1808:ldlm_request_cancel()) ### server-side cancel handler END 00000100:00100000:3.0:1787365408.282165:0:14394:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbfbb80 pname:cluuid+ref:pid:xid:nid:opc:job ldlm_cn00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+16:2361:x1874188003571200:12345-192.168.203.13@tcp:103:ldlm_bl.0 Request processed in 161us (464us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365408.282173:0:14394:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 15 00010000:00010000:0.0:1787365408.286516:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd200/0x872d29295eb482e4 lrc: 0/0,0 mode: --/CR res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 4 type: IBT gid 0 flags: 0x44801400000020 nid: 192.168.203.13@tcp remote: 0x42e1ef2c98989528 expref: 15 pid: 14408 timeout: 625 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365408.286541:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2788f8c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14409:1874188024525824:192.168.203.13@tcp:104: 00010000:00010000:0.0:1787365408.286565:0:14409:0:(ldlm_request.c:298:ldlm_completion_ast()) ### client-side enqueue returned a blocked locksleeping ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4831c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.286577:0:14409:0:(ldlm_request.c:193:ldlm_completion_tail()) ### client-side enqueue: granted ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4831c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.286582:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4831c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787365408.287307:0:14409:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934616 00000001:00080000:0.0:1787365408.287457:0:14409:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934617 00000001:00080000:0.0:1787365408.287504:0:14409:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934618 00000100:00100000:0.0:1787365408.287587:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2788f8c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14409:1874188024525952:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787365408.287754:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365408.287785:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27b690bb40 going to sleep for 11 seconds 00000100:00100000:1.0:1787365408.289167:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024525952 00000100:00100000:1.0:1787365408.289177:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024525952 00000100:00100000:1.0:1787365408.289233:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 0 00000100:00100000:1.0:1787365408.289244:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14409:x1874188024525952:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787365408.289341:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8c000 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14409:x1874188024525952:12345-0@lo:1000:mdt00_001.0 Request processed in 99us (1586us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365408.289349:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 0 00000100:00100000:0.0:1787365408.291377:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2788f8c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14409:1874188024525952:0@lo:1000:mdt00_001.0 00000001:00080000:0.0:1787365408.295435:0:14409:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934619 00000100:00100000:0.0:1787365408.295528:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2788f8c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14409:1874188024526080:0@lo:1000:mdt00_001.0 00000100:00100000:0.0:1787365408.295594:0:14409:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:0.0:1787365408.295853:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f268473f480 going to sleep for 11 seconds 00000100:00100000:1.0:1787365408.302352:0:14413:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024526080 00000100:00100000:1.0:1787365408.302368:0:14413:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024526080 00000100:00100000:1.0:1787365408.302491:0:14413:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 1 00000100:00100000:1.0:1787365408.302501:0:14413:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+6:14409:x1874188024526080:12345-0@lo:1000:mdt00_001.0 00000100:00100000:1.0:1787365408.302819:0:14413:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8f800 pname:cluuid+ref:pid:xid:nid:opc:job mdt_out00_000:lustre-MDT0000-mdtlov_UUID+7:14409:x1874188024526080:12345-0@lo:1000:mdt00_001.0 Request processed in 319us (7224us total) trans 8589934597 rc 0/0 00000100:00100000:1.0:1787365408.302827:0:14413:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 1 00000100:00100000:2.0:1787365408.302935:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2788f8c700 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000-mdtlov_UUID:14409:1874188024526080:0@lo:1000:mdt00_001.0 00010000:00010000:2.0:1787365408.302979:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4831c lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.302990:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4831c lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.302999:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4831c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.303005:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2044400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365408.303010:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4831c lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.303017:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4831c lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.303033:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f27838b1100) 00010000:00010000:2.0:1787365408.303037:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787365408.303055:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4831c lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.303062:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2044400/0x872d29295eb4831c lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x3:0x0].0x0 bits 0x8/0x0 rrc: 3 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.303105:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb48274 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.303113:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb48274 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x50210400000020 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.303120:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb48274 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.303125:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2788f45000 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:2.0:1787365408.303128:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb48274 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40210400000020 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.303133:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb48274 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x40218400000020 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.303141:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f2789e48e00) 00010000:00010000:2.0:1787365408.303144:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 8 00010000:00010000:2.0:1787365408.303150:0:14409:0:(ldlm_inodebits.c:93:ldlm_reprocess_inodebits_queue()) ### Reprocessing lock from queue 3 ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb4827b lrc: 2/0,0 mode: --/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898950c expref: 18 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.303162:0:14409:0:(ldlm_lock.c:715:ldlm_add_cp_work_item()) ### lock granted; sending completion AST. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb4827b lrc: 2/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898950c expref: 18 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.303172:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb4827b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40080000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898950c expref: 18 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.303217:0:14409:0:(ldlm_lockd.c:1082:ldlm_server_completion_ast()) ### server preparing completion AST ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cc800/0x872d29295eb4827b lrc: 3/0,0 mode: CR/CR res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT gid 0 flags: 0x40000000000000 nid: 192.168.203.13@tcp remote: 0x42e1ef2c9898950c expref: 18 pid: 15822 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365408.303230:0:14409:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f2786b55f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14409:1874188024526208:192.168.203.13@tcp:105: 00000100:00100000:2.0:1787365408.303297:0:14409:0:(client.c:2715:ptlrpc_set_wait()) set ffff9f27828f0f00 going to sleep for 11 seconds 00000100:00100000:2.0:1787365408.312399:0:3303:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365408.312498:0:14409:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f2786b55f80 pname:cluuid:pid:xid:nid:opc:job mdt00_001:lustre-MDT0000_UUID:14409:1874188024526208:192.168.203.13@tcp:105: 00010000:00010000:0.0:1787365408.312528:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb48274 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.312539:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f2788f45000/0x872d29295eb48274 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x8/0x0 rrc: 5 type: IBT flags: 0x44a19400000020 pid: 14408 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.312574:0:14409:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb48323 lrc: 3/0,1 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x0/0x0 rrc: 5 type: IBT flags: 0x40000000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.312588:0:14409:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb48323 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.312599:0:14409:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb48323 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.312609:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(EX) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb48323 lrc: 3/0,1 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.312616:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb48323 lrc: 2/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.312658:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb48323 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.312666:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2045400 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365408.312669:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb48323 lrc: 3/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.312796:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb48323 lrc: 4/0,0 mode: EX/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.312815:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f2789e48e00) 00010000:00010000:0.0:1787365408.312830:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 2 00010000:00010000:0.0:1787365408.312834:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb48323 lrc: 2/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.312840:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045400/0x872d29295eb48323 lrc: 0/0,0 mode: --/EX res: [0x200000bd1:0x2:0x0].0x0 bits 0x2/0x0 rrc: 5 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.312851:0:14409:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb48315 lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210000000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.312857:0:14409:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb48315 lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x50210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.312863:0:14409:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb48315 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.312867:0:14409:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27c2045800 already unused, calling callback (ffffffffc20b14f0) 00010000:00010000:0.0:1787365408.312870:0:14409:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb48315 lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40210400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.312877:0:14409:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb48315 lrc: 4/0,0 mode: PW/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x40218400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.314068:0:14409:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x2:0x0].0x0 (ffff9f2789e48e00) 00010000:00010000:0.0:1787365408.314072:0:14409:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 20 00010000:00010000:0.0:1787365408.314076:0:14409:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb48315 lrc: 2/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.314093:0:14409:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27c2045800/0x872d29295eb48315 lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x2:0x0].0x0 bits 0x20/0x0 rrc: 4 type: IBT flags: 0x44a19400000000 pid: 14409 initiator: MDT0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365408.314349:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003571328 00000100:00100000:3.0:1787365408.314358:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003571328 00000100:00100000:3.0:1787365408.314409:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:3.0:1787365408.314418:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b658d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+19:14502:x1874188003571328:12345-192.168.203.13@tcp:49:dd.0 00000100:00100000:3.0:1787365408.314547:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b658d050 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+19:14502:x1874188003571328:12345-192.168.203.13@tcp:49:dd.0 Request processed in 129us (2158us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365408.314554:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 10 00000100:00100000:0.0:1787365408.315907:0:14409:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf9500 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+18:14504:x1874188003571072:12345-192.168.203.13@tcp:57:lhsmtool_posix.0 Request processed in 40861us (45292us total) trans 8589934620 rc 0/0 00000100:00100000:0.0:1787365408.316079:0:14409:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 53 00000020:00080000:0.0:1787365408.316092:0:14409:0:(tgt_main.c:784:tgt_ses_key_exit()) total 5 transactions per RPC 00000040:00080000:2.0:1787365408.316685:0:14442:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:2.0:1787365408.316690:0:14442:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:2.0:1787365408.316726:0:14442:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:2.0:1787365408.316731:0:14442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00000100:00100000:0.0:1787365408.323483:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365408.324297:0:14412:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003571584 00000100:00100000:2.0:1787365408.324306:0:14412:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003571584 00000100:00100000:2.0:1787365408.324364:0:14412:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 11 00000100:00100000:2.0:1787365408.324374:0:14412:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+18:14504:x1874188003571584:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 00000004:00080000:2.0:1787365408.329851:0:14412:0:(mdd_object.c:4014:mdd_close()) Object [0x200000bd1:0x3:0x0] is deleted from orphan list, OSS objects to be destroyed. 00000001:00080000:2.0:1787365408.329992:0:14412:0:(tgt_lastrcvd.c:2117:tgt_txn_stop_cb()) More than one transaction 8589934621 00010000:00010000:2.0:1787365408.330061:0:14412:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb4832a lrc: 3/0,1 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x0/0x0 rrc: 3 type: IBT flags: 0x40000000000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.330079:0:14412:0:(ldlm_lock.c:1072:ldlm_granted_list_add_lock()) ### About to add lock: ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb4832a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010080000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.330102:0:14412:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb4832a lrc: 3/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.330112:0:14412:0:(ldlm_lock.c:954:ldlm_lock_decref_and_cancel()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb4832a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010080000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.330132:0:14412:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb4832a lrc: 4/0,1 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.330138:0:14412:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb4832a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x50010480000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.330172:0:14412:0:(ldlm_lockd.c:2189:__ldlm_bl_to_thread()) added 1/1 locks to regular blp list, 1 blwis in pool 00000100:00100000:2.0:1787365408.330268:0:14412:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8e300 pname:cluuid+ref:pid:xid:nid:opc:job mdt_rdpg00_001:f02bb255-97c1-4c08-8e1d-6c853c05ec45+20:14504:x1874188003571584:12345-192.168.203.13@tcp:35:lhsmtool_posix.0 Request processed in 5892us (6790us total) trans 8589934622 rc 0/0 00000100:00100000:2.0:1787365408.330278:0:14412:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 11 00000020:00080000:2.0:1787365408.330283:0:14412:0:(tgt_main.c:784:tgt_ses_key_exit()) total 2 transactions per RPC 00010000:00010000:0.0:1787365408.334445:0:14397:0:(ldlm_lockd.c:2801:ldlm_bl_get_work()) Got 1 locks of 0 total in blp. (0 blwis in pool) 00010000:00010000:0.0:1787365408.334459:0:14397:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb4832a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.334470:0:14397:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cd400 already unused, calling callback (ffffffffc1672420) 00010000:00010000:0.0:1787365408.334474:0:14397:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb4832a lrc: 2/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40010480000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.334483:0:14397:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb4832a lrc: 3/0,0 mode: PW/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x40018480000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.334501:0:14397:0:(ldlm_inodebits.c:74:ldlm_reprocess_inodebits_queue()) --- Reprocess resource [0x200000bd1:0x3:0x0].0x0 (ffff9f27838b1100) 00010000:00010000:0.0:1787365408.334504:0:14397:0:(ldlm_inodebits.c:76:ldlm_reprocess_inodebits_queue()) Hint 40 00010000:00010000:0.0:1787365408.334508:0:14397:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb4832a lrc: 1/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.334515:0:14397:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: mdt-lustre-MDT0000_UUID lock: ffff9f27a12cd400/0x872d29295eb4832a lrc: 0/0,0 mode: --/PW res: [0x200000bd1:0x3:0x0].0x0 bits 0x40/0x0 rrc: 3 type: IBT flags: 0x44819480000000 pid: 14412 initiator: MDT0 lru_score: 0 lru_type: 0 00010000:00010000:0.0:1787365408.334527:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365408.334529:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:0.0:1787365408.334531:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365408.439778:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:2.0:1787365408.724503:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365408.726396:0:15097:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003571712 00000100:00100000:1.0:1787365408.726409:0:15097:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003571712 00000100:00100000:1.0:1787365408.726483:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:1.0:1787365408.726494:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+7:2360:x1874188003571712:12345-192.168.203.13@tcp:4:dd.0 00002000:00010000:1.0:1787365408.726552:0:15097:0:(ofd_lvb.c:151:ofd_lvbo_init()) res: [0x280000400:0x22:0x0] initial LVB size: 0, mtime: 0x6a89081e, atime: 0x6a89081d, ctime: 0x6a89081e, blocks: 0x1 00010000:00010000:1.0:1787365408.726576:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab282a2c/0x872d29295eb48331 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.726593:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=525s v=(0 0) 00010000:00010000:1.0:1787365408.726598:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365408.726604:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000ab282a2c/0x872d29295eb48331 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.726619:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000ab282a2c/0x872d29295eb48331 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365408.728606:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365408.728706:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365408.729033:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:2.0:1787365408.729043:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_003' 00000100:00100000:0.0:1787365408.729448:0:15098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003571840 00000100:00100000:0.0:1787365408.729456:0:15098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003571840 00000100:00100000:0.0:1787365408.729497:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 3 min 3 max 116 00000100:00100000:0.0:1787365408.729512:0:15098:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003571968 00000100:00100000:0.0:1787365408.729515:0:15098:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003571968 00000100:00100000:2.0:1787365408.730000:0:16638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:2.0:1787365408.730010:0:16638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f02bb255-97c1-4c08-8e1d-6c853c05ec45+9:2360:x1874188003571840:12345-192.168.203.13@tcp:4:dd.0 00010000:00010000:2.0:1787365408.730041:0:16638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050a79875/0x872d29295eb48338 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.730058:0:16638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365408.730062:0:16638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365408.730069:0:16638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 0000000050a79875/0x872d29295eb48338 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365408.730092:0:16638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 0000000050a79875/0x872d29295eb48338 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:0.0:1787365408.750048:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365408.750106:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365408.750138:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365408.750151:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:0.0:1787365408.750176:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365408.750264:0:15098:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:1.0:1787365408.750274:0:15098:0:(service.c:3521:ptlrpc_start_thread()) starting thread 'll_ost_io00_004' 00000100:00100000:3.0:1787365408.751584:0:15099:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787365408.751600:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003572096 00000100:00100000:3.0:1787365408.751608:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003572096 00000100:00100000:3.0:1787365408.751684:0:15099:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787365408.751690:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003572352 00000100:00100000:3.0:1787365408.751693:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003572352 00000100:00100000:3.0:1787365408.751705:0:15099:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787365408.751710:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003572608 00000100:00100000:3.0:1787365408.751712:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003572608 00000100:00100000:3.0:1787365408.751723:0:15099:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787365408.751726:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003572224 00000100:00100000:3.0:1787365408.751728:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003572224 00000100:00100000:3.0:1787365408.751738:0:15099:0:(service.c:3462:ptlrpc_start_thread()) ost_io[0] started 4 min 3 max 116 00000100:00100000:3.0:1787365408.751742:0:15099:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003572480 00000100:00100000:3.0:1787365408.751744:0:15099:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003572480 00000100:00100000:1.0:1787365408.753086:0:16639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:1.0:1787365408.753101:0:16639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f02bb255-97c1-4c08-8e1d-6c853c05ec45+16:2360:x1874188003571968:12345-192.168.203.13@tcp:4:dd.0 00010000:00010000:1.0:1787365408.753137:0:16639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002aaa7b01/0x872d29295eb4833f lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.753153:0:16639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365408.753158:0:16639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365408.753175:0:16639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000002aaa7b01/0x872d29295eb4833f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365408.753190:0:16639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000002aaa7b01/0x872d29295eb4833f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787365408.956264:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934596 is committed 00000001:00080000:2.0:1787365408.956279:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934595 is committed 00000001:00080000:2.0:1787365408.956286:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934598 is committed 00000001:00080000:2.0:1787365408.956296:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934597 is committed 00002000:00010000:3.0:1787365408.956333:0:16638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 0 -> 3145728 00002000:00010000:3.0:1787365408.956342:0:16638:0:(ofd_lvb.c:313:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb mtime from disk: 1787365406 -> 1787365408 00002000:00010000:3.0:1787365408.956346:0:16638:0:(ofd_lvb.c:325:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb ctime from disk: 1787365406 -> 1787365408 00002000:00010000:3.0:1787365408.956350:0:16638:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 1 -> 2055 00010000:00010000:3.0:1787365408.956368:0:16638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 0000000050a79875/0x872d29295eb48338 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.956406:0:16638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 0000000050a79875/0x872d29295eb48338 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.956417:0:16638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 0000000050a79875/0x872d29295eb48338 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.956426:0:16638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cde00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365408.956432:0:16638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 0000000050a79875/0x872d29295eb48338 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.956444:0:16638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 0000000050a79875/0x872d29295eb48338 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.956485:0:16638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 0000000050a79875/0x872d29295eb48338 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.956495:0:16638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 0000000050a79875/0x872d29295eb48338 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [1048576->2097151] (req 1048576->2097151) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365408.956814:0:16638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8f100 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f02bb255-97c1-4c08-8e1d-6c853c05ec45+18:2360:x1874188003571840:12345-192.168.203.13@tcp:4:dd.0 Request processed in 226797us (228207us total) trans 8589934598 rc 0/0 00000100:00100000:3.0:1787365408.956917:0:16638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 1 00000100:00100000:3.0:1787365408.956965:0:16638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:3.0:1787365408.956982:0:16638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f02bb255-97c1-4c08-8e1d-6c853c05ec45+17:2360:x1874188003572096:12345-192.168.203.13@tcp:4:dd.0 00010000:00010000:3.0:1787365408.957024:0:16638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fae4950c/0x872d29295eb48346 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.957048:0:16638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=1s v=(0 0) 00010000:00010000:3.0:1787365408.957053:0:16638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365408.957061:0:16638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000fae4950c/0x872d29295eb48346 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365408.957086:0:16638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000fae4950c/0x872d29295eb48346 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:2.0:1787365409.077140:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934600 is committed 00002000:00010000:2.0:1787365409.077249:0:15097:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 3145728 -> 4194304 00002000:00010000:2.0:1787365409.077255:0:15097:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 2055 -> 6151 00010000:00010000:2.0:1787365409.077272:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000ab282a2c/0x872d29295eb48331 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365409.077286:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000ab282a2c/0x872d29295eb48331 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365409.077296:0:15097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000ab282a2c/0x872d29295eb48331 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365409.077304:0:15097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114e00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:2.0:1787365409.077310:0:15097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab282a2c/0x872d29295eb48331 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365409.077320:0:15097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000ab282a2c/0x872d29295eb48331 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365409.077345:0:15097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000ab282a2c/0x872d29295eb48331 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365409.077376:0:15097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000ab282a2c/0x872d29295eb48331 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->1048575] (req 0->1048575) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.077671:0:16639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000002aaa7b01/0x872d29295eb4833f lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.077682:0:16639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000002aaa7b01/0x872d29295eb4833f lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.077690:0:16639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000002aaa7b01/0x872d29295eb4833f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.077697:0:16639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114c00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365409.077700:0:16639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000002aaa7b01/0x872d29295eb4833f lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.077707:0:16639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000002aaa7b01/0x872d29295eb4833f lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.077718:0:16639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000002aaa7b01/0x872d29295eb4833f lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.077748:0:16639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000002aaa7b01/0x872d29295eb4833f lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [2097152->3145727] (req 2097152->3145727) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365409.077812:0:16639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8f480 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f02bb255-97c1-4c08-8e1d-6c853c05ec45+14:2360:x1874188003571968:12345-192.168.203.13@tcp:4:dd.0 Request processed in 324709us (349098us total) trans 8589934600 rc 0/0 00000100:00100000:3.0:1787365409.077824:0:16639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 2 00000100:00100000:3.0:1787365409.077862:0:16639:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 4 00000100:00100000:3.0:1787365409.077886:0:16639:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f02bb255-97c1-4c08-8e1d-6c853c05ec45+13:2360:x1874188003572352:12345-192.168.203.13@tcp:4:dd.0 00010000:00010000:3.0:1787365409.077924:0:16639:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eb8d907/0x872d29295eb4834d lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.077938:0:16639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365409.077943:0:16639:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365409.077950:0:16639:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000006eb8d907/0x872d29295eb4834d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.077964:0:16639:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000006eb8d907/0x872d29295eb4834d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00080000:3.0:1787365409.078096:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00100000:2.0:1787365409.078349:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b56680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+14:2360:x1874188003571712:12345-192.168.203.13@tcp:4:dd.0 Request processed in 351856us (353852us total) trans 8589934599 rc 0/0 00000100:00100000:2.0:1787365409.078358:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 0 00000100:00100000:2.0:1787365409.078375:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:2.0:1787365409.078383:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+13:2360:x1874188003572608:12345-192.168.203.13@tcp:4:dd.0 00010000:00010000:2.0:1787365409.078403:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fa58d43/0x872d29295eb48354 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365409.078413:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365409.078415:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:2.0:1787365409.078420:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 000000000fa58d43/0x872d29295eb48354 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365409.078431:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 000000000fa58d43/0x872d29295eb48354 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:1.0:1787365409.187775:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934601 is committed 00002000:00010000:1.0:1787365409.190536:0:16638:0:(ofd_lvb.c:306:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb size from disk: 4194304 -> 7654321 00002000:00010000:1.0:1787365409.190566:0:16638:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 6151 -> 8199 00010000:00010000:1.0:1787365409.190584:0:16638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000fae4950c/0x872d29295eb48346 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365409.190599:0:16638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000fae4950c/0x872d29295eb48346 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365409.190609:0:16638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000fae4950c/0x872d29295eb48346 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365409.190616:0:16638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780031e00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:1.0:1787365409.190622:0:16638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000fae4950c/0x872d29295eb48346 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365409.190652:0:16638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000fae4950c/0x872d29295eb48346 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365409.190678:0:16638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000fae4950c/0x872d29295eb48346 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365409.190687:0:16638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000fae4950c/0x872d29295eb48346 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [3145728->4194303] (req 3145728->4194303) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:1.0:1787365409.190809:0:16638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8dc00 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f02bb255-97c1-4c08-8e1d-6c853c05ec45+15:2360:x1874188003572096:12345-192.168.203.13@tcp:4:dd.0 Request processed in 233828us (440762us total) trans 8589934601 rc 0/0 00000100:00100000:1.0:1787365409.190821:0:16638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 3 00000100:00100000:1.0:1787365409.190871:0:16638:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 6 00000100:00100000:1.0:1787365409.190891:0:16638:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f02bb255-97c1-4c08-8e1d-6c853c05ec45+14:2360:x1874188003572224:12345-192.168.203.13@tcp:4:dd.0 00010000:00010000:1.0:1787365409.190932:0:16638:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb4835b lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365409.190946:0:16638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365409.190952:0:16638:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:1.0:1787365409.190959:0:16638:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb4835b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:1.0:1787365409.190972:0:16638:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb4835b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000001:00080000:0.0:1787365409.344319:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934602 is committed 00000001:00080000:0.0:1787365409.344349:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934603 is committed 00002000:00010000:3.0:1787365409.345231:0:15097:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 8199 -> 12295 00010000:00010000:3.0:1787365409.345257:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000000fa58d43/0x872d29295eb48354 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.345274:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000000fa58d43/0x872d29295eb48354 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.345297:0:15097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000000fa58d43/0x872d29295eb48354 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.345306:0:15097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f27a12cd200 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365409.345311:0:15097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000000fa58d43/0x872d29295eb48354 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.345321:0:15097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000000fa58d43/0x872d29295eb48354 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.345344:0:15097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000000fa58d43/0x872d29295eb48354 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.345353:0:15097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000000fa58d43/0x872d29295eb48354 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [7340032->7655423] (req 7340032->7655423) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365409.345460:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8c380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+12:2360:x1874188003572608:12345-192.168.203.13@tcp:4:dd.0 Request processed in 267072us (595314us total) trans 8589934602 rc 0/0 00000100:00100000:3.0:1787365409.345472:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 5 00000100:00100000:3.0:1787365409.345507:0:15097:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1787365409.345933:0:15097:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2788f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+11:2360:x1874188003572480:12345-192.168.203.13@tcp:4:dd.0 00010000:00010000:3.0:1787365409.345974:0:15097:0:(ldlm_lock.c:775:ldlm_lock_addref_internal_nolock()) ### ldlm_lock_addref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3043d1e/0x872d29295eb48362 lrc: 3/0,1 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [0->0] (req 0->0) gid 0 flags: 0x40000000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.345988:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365409.345999:0:15097:0:(ldlm_extent.c:408:ldlm_update_contention()) add 0 to [0x280000400:0x22:0x0].0x0 since=0s v=(0 0) 00010000:00010000:3.0:1787365409.346007:0:15097:0:(ldlm_resource.c:1750:ldlm_resource_add_lock()) ### About to add this lock ns: filter-lustre-OST0001_UUID lock: 00000000b3043d1e/0x872d29295eb48362 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.346020:0:15097:0:(ldlm_request.c:557:ldlm_cli_enqueue_local()) ### client-side local enqueue handler, new lock created ns: filter-lustre-OST0001_UUID lock: 00000000b3043d1e/0x872d29295eb48362 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.346182:0:16639:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 000000006eb8d907/0x872d29295eb4834d lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.346192:0:16639:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 000000006eb8d907/0x872d29295eb4834d lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.346200:0:16639:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 000000006eb8d907/0x872d29295eb4834d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.346207:0:16639:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780030c00 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365409.346211:0:16639:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 000000006eb8d907/0x872d29295eb4834d lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.346218:0:16639:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 000000006eb8d907/0x872d29295eb4834d lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.346230:0:16639:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 000000006eb8d907/0x872d29295eb4834d lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.346237:0:16639:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 000000006eb8d907/0x872d29295eb4834d lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 4 type: EXT [5242880->6291455] (req 5242880->6291455) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16639 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365409.346282:0:16639:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8d880 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_004:f02bb255-97c1-4c08-8e1d-6c853c05ec45+11:2360:x1874188003572352:12345-192.168.203.13@tcp:4:dd.0 Request processed in 268412us (596176us total) trans 8589934603 rc 0/0 00000100:00100000:3.0:1787365409.346291:0:16639:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 4 00000001:00080000:0.0:1787365409.459248:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934604 is committed 00010000:00010000:0.0:1787365409.459296:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00002000:00010000:2.0:1787365409.459860:0:16638:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 12295 -> 14343 00010000:00010000:2.0:1787365409.459881:0:16638:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb4835b lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365409.459897:0:16638:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb4835b lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365409.459925:0:16638:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb4835b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365409.459933:0:16638:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2798114200 already unused, calling callback (ffffffffc1672420) 00010000:00010000:2.0:1787365409.459939:0:16638:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb4835b lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365409.459960:0:16638:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb4835b lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365409.459983:0:16638:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb4835b lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:2.0:1787365409.459992:0:16638:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000f81a53ec/0x872d29295eb4835b lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 3 type: EXT [4194304->5242879] (req 4194304->5242879) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 16638 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:2.0:1787365409.460111:0:16638:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8e680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_003:f02bb255-97c1-4c08-8e1d-6c853c05ec45+9:2360:x1874188003572224:12345-192.168.203.13@tcp:4:dd.0 Request processed in 269219us (709951us total) trans 8589934604 rc 0/0 00000100:00100000:2.0:1787365409.460124:0:16638:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 6 00000001:00080000:1.0:1787365409.550297:0:7624:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-OST0001: transno 8589934605 is committed 00002000:00010000:3.0:1787365409.550464:0:15097:0:(ofd_lvb.c:331:ofd_lvbo_update()) res: [0x280000400:0x22:0x0] updating lvb blocks from disk: 14343 -> 16391 00010000:00010000:3.0:1787365409.550483:0:15097:0:(ldlm_lock.c:829:ldlm_lock_decref_internal_nolock()) ### ldlm_lock_decref(PW) ns: filter-lustre-OST0001_UUID lock: 00000000b3043d1e/0x872d29295eb48362 lrc: 3/0,1 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010000000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.550499:0:15097:0:(ldlm_lock.c:887:ldlm_lock_decref_internal()) ### final decref done on CBPENDING lock ns: filter-lustre-OST0001_UUID lock: 00000000b3043d1e/0x872d29295eb48362 lrc: 2/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x50010400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.550510:0:15097:0:(ldlm_lockd.c:1907:ldlm_handle_bl_callback()) ### client blocking AST callback handler ns: filter-lustre-OST0001_UUID lock: 00000000b3043d1e/0x872d29295eb48362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.550517:0:15097:0:(ldlm_lockd.c:1921:ldlm_handle_bl_callback()) Lock ffff9f2780031800 already unused, calling callback (ffffffffc1672420) 00010000:00010000:3.0:1787365409.550524:0:15097:0:(ldlm_request.c:378:ldlm_blocking_ast_nocheck()) ### already unused, calling ldlm_cli_cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3043d1e/0x872d29295eb48362 lrc: 3/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40010400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.550535:0:15097:0:(ldlm_request.c:1416:ldlm_cli_cancel_local()) ### server-side local cancel ns: filter-lustre-OST0001_UUID lock: 00000000b3043d1e/0x872d29295eb48362 lrc: 4/0,0 mode: PW/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x40018400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.550558:0:15097:0:(ldlm_lockd.c:1933:ldlm_handle_bl_callback()) ### client blocking callback handler END ns: filter-lustre-OST0001_UUID lock: 00000000b3043d1e/0x872d29295eb48362 lrc: 2/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00010000:00010000:3.0:1787365409.550566:0:15097:0:(ldlm_lock.c:193:ldlm_lock_put()) ### final lock_put on destroyed lock, freeing it. ns: filter-lustre-OST0001_UUID lock: 00000000b3043d1e/0x872d29295eb48362 lrc: 0/0,0 mode: --/PW res: [0x280000400:0x22:0x0].0x0 rrc: 2 type: EXT [6291456->7340031] (req 6291456->7340031) gid 0 flags: 0x44819400000000 nid: local remote: 0x0 expref: -99 pid: 15097 timeout: 0 lvb_type: 0 lru_score: 0 lru_type: 0 00000100:00100000:3.0:1787365409.550740:0:15097:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2788f8fb80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_io00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+5:2360:x1874188003572480:12345-192.168.203.13@tcp:4:dd.0 Request processed in 205217us (800564us total) trans 8589934605 rc 0/0 00000100:00100000:3.0:1787365409.550753:0:15097:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 7 00000100:00100000:3.0:1787365409.651364:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024526720:0@lo:400:kworker.0 00000100:00100000:3.0:1787365409.651454:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365409.651535:0:3312:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 2 async RPCs [3->2] 00000100:00100000:3.0:1787365409.651541:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb55b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3312:1874188024526336:0@lo:400:kworker.0 00000100:00100000:3.0:1787365409.651583:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365409.651604:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb55aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024526848:0@lo:400:kworker.0 00000100:00100000:3.0:1787365409.651623:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365409.651665:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb559880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024526464:0@lo:400:kworker.0 00000100:00100000:3.0:1787365409.651690:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365409.651803:0:14401:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024526336 00000100:00100000:2.0:1787365409.651812:0:14401:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024526336 00000100:00100000:2.0:1787365409.651859:0:14401:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787365409.651868:0:14401:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:3312:x1874188024526336:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365409.651931:0:14401:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65ae850 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0000:f26df4b8-3dbe-45e2-8af9-ef09f94ac229+19:3312:x1874188024526336:12345-0@lo:400:kworker.0 Request processed in 59us (342us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365409.651957:0:14401:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 124 00000100:00100000:2.0:1787365409.651992:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024526720 00000100:00100000:2.0:1787365409.651996:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024526720 00000100:00100000:2.0:1787365409.652017:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024526848 00000100:00100000:2.0:1787365409.652019:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024526848 00000100:00100000:2.0:1787365409.652044:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787365409.652050:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb55bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024526720:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365409.652092:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb55bb80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-MDT0000_UUID+5:3312:x1874188024526720:12345-0@lo:400:kworker.0 Request processed in 42us (639us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365409.652099:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 30 00000100:00100000:2.0:1787365409.652109:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 31 00000100:00100000:2.0:1787365409.652115:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb55ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024526848:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365409.652143:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb55ad80 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0000_UUID+5:3312:x1874188024526848:12345-0@lo:400:kworker.0 Request processed in 29us (519us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365409.652149:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 31 00000100:00080000:2.0:1787365409.652167:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:2.0:1787365409.652192:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb55b100 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:f26df4b8-3dbe-45e2-8af9-ef09f94ac229:3312:1874188024526336:0@lo:400:kworker.0 00000100:00100000:2.0:1787365409.652204:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb55aa00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-OST0000_UUID:3312:1874188024526848:0@lo:400:kworker.0 00000100:00100000:2.0:1787365409.652212:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb559f80 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-lwp-MDT0000_UUID:3312:1874188024526720:0@lo:400:kworker.0 00000100:00100000:3.0:1787365409.653291:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb55a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874188024526976:0@lo:400:kworker.0 00000100:00100000:3.0:1787365409.653339:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:3.0:1787365409.653362:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787365409.653367:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024526592:0@lo:400:kworker.0 00000100:00100000:3.0:1787365409.653392:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:2.0:1787365409.653887:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024526464 00000100:00100000:2.0:1787365409.653894:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024526464 00000100:00100000:2.0:1787365409.653949:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024526592 00000100:00100000:2.0:1787365409.653952:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024526592 00000100:00100000:2.0:1787365409.653966:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787365409.653979:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb558380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024526464:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365409.654045:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb558380 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024526464:12345-0@lo:400:kworker.0 Request processed in 67us (2353us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365409.654052:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 19 00000100:00100000:2.0:1787365409.654066:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 20 00000100:00100000:2.0:1787365409.654081:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024526592:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365409.654108:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb559500 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024526592:12345-0@lo:400:kworker.0 Request processed in 37us (715us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365409.654114:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 20 00000100:00080000:2.0:1787365409.654128:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00000100:00100000:2.0:1787365409.654137:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024526976 00000100:00100000:2.0:1787365409.654140:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024526976 00000100:00100000:2.0:1787365409.654165:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 32 00000100:00100000:2.0:1787365409.654170:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874188024526976:12345-0@lo:400:kworker.0 00000100:00100000:2.0:1787365409.654201:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb559c00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:lustre-MDT0000-lwp-OST0001_UUID+5:3310:x1874188024526976:12345-0@lo:400:kworker.0 Request processed in 31us (862us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365409.654208:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 32 00000100:00080000:2.0:1787365409.654222:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:3.0:1787365409.656866:0:3310:0:(client.c:3125:ptlrpc_free_committed()) lustre-OST0001-osc-MDT0000: committing for last_committed 8589934597 gen 2 00000004:00080000:3.0:1787365409.656881:0:3310:0:(osp_sync.c:570:osp_sync_request_commit_cb()) commit req ffff9f27b6be5500, transno 8589934595 00000004:00080000:3.0:1787365409.656906:0:3310:0:(osp_trans.c:1040:osp_request_commit_cb()) trans no 8589934597 committed transno 8589934597 00000100:00100000:3.0:1787365409.656936:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb558e00 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024526592:0@lo:400:kworker.0 00000100:00100000:3.0:1787365409.656952:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb559880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024526464:0@lo:400:kworker.0 00000100:00100000:3.0:1787365409.656965:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb55a300 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-lwp-OST0001_UUID:3310:1874188024526976:0@lo:400:kworker.0 00000100:00100000:3.0:1787365409.657006:0:3310:0:(ptlrpcd.c:344:ptlrpcd_check()) transfer 1 async RPCs [1->0] 00000100:00100000:3.0:1787365409.657016:0:3310:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bbbfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024527104:0@lo:13:osp-pre-1-0.0 00000100:00100000:3.0:1787365409.657092:0:3310:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365409.657598:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024527104 00000100:00100000:1.0:1787365409.657607:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024527104 00000100:00100000:1.0:1787365409.657696:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 14 00000100:00100000:1.0:1787365409.657713:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb55a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024527104:12345-0@lo:13:osp-pre-1-0.0 00002000:00000024:1.0:1787365409.657741:0:15095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 3407872 granted 71499776 pending 0 free 3859808256 avail 3849322496 00000100:00100000:1.0:1787365409.657799:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb55a300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3310:x1874188024527104:12345-0@lo:13:osp-pre-1-0.0 Request processed in 78us (697us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365409.657806:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 14 00000100:00100000:0.0:1787365409.657952:0:3310:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bbbfb800 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_00:lustre-MDT0000-mdtlov_UUID:3310:1874188024527104:0@lo:13:osp-pre-1-0.0 00000100:00100000:2.0:1787365410.165122:0:3312:0:(client.c:1919:ptlrpc_send_new_req()) Sending RPC req@ffff9f27bb559880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024527232:0@lo:13:osp-pre-0-0.0 00000100:00100000:2.0:1787365410.165225:0:3312:0:(events.c:340:request_in_callback()) peer: 12345-0@lo (source: 12345-0@lo) 00000100:00100000:1.0:1787365410.167012:0:15095:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188024527232 00000100:00100000:1.0:1787365410.167028:0:15095:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188024527232 00000100:00100000:1.0:1787365410.167124:0:15095:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-0@lo, seq: 15 00000100:00100000:1.0:1787365410.167136:0:15095:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f2786b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024527232:12345-0@lo:13:osp-pre-0-0.0 00002000:00000024:1.0:1787365410.167186:0:15095:0:(ofd_obd.c:735:ofd_statfs()) blocks cached 0 granted 47644672 pending 0 free 3859808256 avail 3857711104 00000100:00100000:1.0:1787365410.167287:0:15095:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f2786b56d80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost_create00:lustre-MDT0000-mdtlov_UUID+5:3312:x1874188024527232:12345-0@lo:13:osp-pre-0-0.0 Request processed in 153us (2061us total) trans 0 rc 0/0 00000100:00100000:1.0:1787365410.167311:0:15095:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-0@lo, seq: 15 00000100:00100000:2.0:1787365410.169928:0:3312:0:(client.c:2414:ptlrpc_check_set()) Completed RPC req@ffff9f27bb559880 pname:cluuid:pid:xid:nid:opc:job ptlrpcd_00_02:lustre-MDT0000-mdtlov_UUID:3312:1874188024527232:0@lo:13:osp-pre-0-0.0 00010000:00010000:2.0:1787365410.482994:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365411.515872:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:02000400:3.0:1787365411.830281:0:16677:0:(debug.c:653:libcfs_debug_mark_buffer()) DEBUG MARKER: sanity-pcc test_1c: @@@@@@ FAIL: expected /mnt/pcc.d1c.sanity-pcc/d1c.sanity-pcc/0bd3/0x200000bd1:0x2:0x0 size: 7654321 got: 0 00000040:00080000:3.0:1787365412.405897:0:14442:0:(llog.c:805:llog_process_thread()) index: 2, lh_last_idx: 2 synced_idx: 2 lgh_last_idx: 2 00000040:00080000:3.0:1787365412.405905:0:14442:0:(llog_cat.c:163:llog_cat_process_common()) processing log [0x1:0xe:0x0] at index 2 of catalog [0xa:0x7:0x0] 00000040:00080000:3.0:1787365412.405937:0:14442:0:(llog.c:862:llog_process_thread()) stop processing plain [0x1:0xe:0x0] index 2 count 2 00000040:00080000:3.0:1787365412.405943:0:14442:0:(llog.c:862:llog_process_thread()) stop processing catalog [0xa:0x7:0x0] index 3 count 2 00010000:00010000:2.0:1787365412.532568:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000100:00100000:3.0:1787365413.254416:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365413.254458:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365413.254491:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365413.254547:0:3304:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:3.0:1787365413.254593:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003572864 00000100:00100000:3.0:1787365413.254607:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003572864 00000100:00100000:3.0:1787365413.254717:0:14410:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003573248 00000100:00100000:3.0:1787365413.254721:0:14410:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003573248 00000100:00100000:3.0:1787365413.255269:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:3.0:1787365413.255283:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+20:2362:x1874188003572864:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365413.255389:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb558e00 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+20:2362:x1874188003572864:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 109us (991us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365413.255398:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 33 00000100:00100000:3.0:1787365413.255419:0:14410:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:3.0:1787365413.255426:0:14410:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+6:2362:x1874188003573248:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365413.255451:0:14410:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb559180 pname:cluuid+ref:pid:xid:nid:opc:job mdt00_002:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+6:2362:x1874188003573248:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 27us (994us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365413.255458:0:14410:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 34 00000100:00100000:3.0:1787365413.255683:0:14403:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003572736 00000100:00100000:3.0:1787365413.255689:0:14403:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003572736 00000100:00100000:3.0:1787365413.255735:0:14403:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:3.0:1787365413.255743:0:14403:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27b65afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+13:2362:x1874188003572736:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365413.255773:0:14403:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27b65afc50 pname:cluuid+ref:pid:xid:nid:opc:job ll_mgs_0002:fe404169-601c-4b3f-a2f6-d9e3817a2d0c+13:2362:x1874188003572736:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 32us (1280us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365413.255780:0:14403:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 125 00000100:00100000:3.0:1787365413.255817:0:15091:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003573120 00000100:00100000:3.0:1787365413.255822:0:15091:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003573120 00000100:00100000:3.0:1787365413.255855:0:15091:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:3.0:1787365413.255862:0:15091:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bb558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+5:2362:x1874188003573120:12345-192.168.203.13@tcp:400:kworker.0 00000100:00100000:3.0:1787365413.255906:0:15091:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bb558a80 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_000:f02bb255-97c1-4c08-8e1d-6c853c05ec45+5:2362:x1874188003573120:12345-192.168.203.13@tcp:400:kworker.0 Request processed in 45us (1359us total) trans 0 rc 0/0 00000100:00100000:3.0:1787365413.255914:0:15091:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00080000:3.0:1787365413.255934:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:3.0:1787365413.255939:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-MDT0000 00000100:00100000:1.0:1787365413.268352:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365413.268396:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:1.0:1787365413.268426:0:3305:0:(events.c:340:request_in_callback()) peer: 12345-192.168.203.13@tcp (source: 12345-192.168.203.13@tcp) 00000100:00100000:2.0:1787365413.268713:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003572992 00000100:00100000:2.0:1787365413.268735:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003572992 00000100:00100000:2.0:1787365413.268811:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003573376 00000100:00100000:2.0:1787365413.268815:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003573376 00000100:00100000:2.0:1787365413.268839:0:15094:0:(service.c:2301:ptlrpc_server_handle_req_in()) unwrap req x1874188003573504 00000100:00100000:2.0:1787365413.268843:0:15094:0:(service.c:2366:ptlrpc_server_handle_req_in()) got req x1874188003573504 00000100:00100000:2.0:1787365413.268864:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:2.0:1787365413.268873:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+5:2358:x1874188003572992:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:2.0:1787365413.268912:0:15094:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb48059 00000100:00080000:2.0:1787365413.268931:0:15094:0:(import.c:65:import_set_state_nolock()) ffff9f268673b000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787365413.268981:0:15094:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1787365413.269344:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbfa680 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:f02bb255-97c1-4c08-8e1d-6c853c05ec45+2:2358:x1874188003572992:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 471us (1016us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365413.269353:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 19 00000100:00100000:2.0:1787365413.269374:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:2.0:1787365413.269381:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+5:2358:x1874188003573376:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:2.0:1787365413.269395:0:15094:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb48091 00000100:00080000:2.0:1787365413.269401:0:15094:0:(import.c:65:import_set_state_nolock()) ffff9f2784258000 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787365413.269421:0:15094:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0000_UUID: mount_count is 2, last_transno is 8589934593 00000100:00100000:2.0:1787365413.269494:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbfa300 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+2:2358:x1874188003573376:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 113us (1097us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365413.269502:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 20 00000100:00100000:2.0:1787365413.269515:0:15094:0:(nrs_fifo.c:152:nrs_fifo_req_get()) NRS start fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00100000:2.0:1787365413.269522:0:15094:0:(service.c:2552:ptlrpc_server_handle_request()) Handling RPC req@ffff9f27bbbf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+5:2358:x1874188003573504:12345-192.168.203.13@tcp:9:kworker.0 00000020:00000080:2.0:1787365413.269534:0:15094:0:(genops.c:1468:class_disconnect()) disconnect: cookie 0x872d29295eb48098 00000100:00080000:2.0:1787365413.269542:0:15094:0:(import.c:65:import_set_state_nolock()) ffff9f278425a800 : changing import state from FULL to CLOSED 00000001:00000004:2.0:1787365413.269560:0:15094:0:(tgt_lastrcvd.c:727:tgt_server_data_update()) lustre-OST0001_UUID: mount_count is 2, last_transno is 8589934605 00000100:00100000:2.0:1787365413.269753:0:15094:0:(service.c:2610:ptlrpc_server_handle_request()) Handled RPC req@ffff9f27bbbf9180 pname:cluuid+ref:pid:xid:nid:opc:job ll_ost00_002:2e9384cd-bbb4-4fb3-8f68-e232a62cc4d9+2:2358:x1874188003573504:12345-192.168.203.13@tcp:9:kworker.0 Request processed in 230us (1325us total) trans 0 rc 0/0 00000100:00100000:2.0:1787365413.269761:0:15094:0:(nrs_fifo.c:211:nrs_fifo_req_stop()) NRS stop fifo request from 12345-192.168.203.13@tcp, seq: 21 00000100:00080000:2.0:1787365413.269795:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0001 00000100:00080000:2.0:1787365413.269799:0:14404:0:(pinger.c:500:ping_evictor_main()) evicting all exports of obd lustre-OST0000 00010000:00010000:2.0:1787365413.269859:0:14397:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00010000:00010000:2.0:1787365413.270044:0:14396:0:(ldlm_lockd.c:2804:ldlm_bl_get_work()) No blwi found in queue (no bl locks in queue) 00000001:00080000:3.0:1787365413.314831:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934620 is committed 00000020:00080000:3.0:1787365413.314844:0:5855:0:(update_trans.c:59:top_multiple_thandle_dump()) lustre-MDT0000-osd tmt ffff9f27b690bcc0 refcount 2 committed 0 result 0 batchid 4294967527 00000020:00080000:3.0:1787365413.314850:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f27b6b55000 obd lustre-OST0001-osc-MDT0000 committed 1 started 1 stopped 1 result 0 sub_th ffff9f2797a56540 00000020:00080000:3.0:1787365413.314854:0:5855:0:(update_trans.c:67:top_multiple_thandle_dump()) st ffff9f27b6b55a00 obd lustre-MDT0000-osd committed 1 started 1 stopped 1 result 0 sub_th ffff9f26876af400 00000001:00080000:3.0:1787365413.314899:0:5855:0:(tgt_lastrcvd.c:983:tgt_cb_last_committed()) lustre-MDT0000: transno 8589934622 is committed 00000020:00080000:1.0:1787365413.314911:0:14446:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 4294967527 committed batchid 8 00000020:00080000:1.0:1787365413.315225:0:14446:0:(update_trans.c:1590:distribute_txn_commit_thread()) lustre-MDT0000: batchid: 0 committed batchid 8 Debug log: 29888 lines, 29888 kept, 0 dropped, 0 bad.